-- Logs begin at Mon 2022-01-24 16:12:23 UTC, end at Mon 2022-01-24 17:09:02 UTC. -- Jan 24 16:41:41.102586 dv-cinder-826116-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 16:41:41.111187 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 16:41:41 2022] *** Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: nodename: dv-cinder-826116-1-iscsi Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: machine: x86_64 Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: clock source: unix Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: pcre jit disabled Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: detected number of CPU cores: 4 Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: current working directory: / Jan 24 16:41:41.113037 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: detected binary path: /usr/bin/uwsgi-core Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: your processes number limit is 47680 Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: your memory page size is 4096 bytes Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: detected max file descriptor number: 2048 Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: lock engine: pthread robust mutexes Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: thunder lock: enabled Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 16:41:41.113645 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 16:41:41.158463 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: Python main interpreter initialized at 0x55d8a68b39c0 Jan 24 16:41:41.158463 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: python threads support enabled Jan 24 16:41:41.158463 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: your server socket listen backlog is limited to 100 connections Jan 24 16:41:41.158463 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: your mercy for graceful operations on workers is 90 seconds Jan 24 16:41:41.158817 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 16:41:41.158919 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: *** Operational MODE: preforking *** Jan 24 16:41:41.159180 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: *** uWSGI is running in multiple interpreter mode *** Jan 24 16:41:41.159180 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: spawned uWSGI master process (pid: 113341) Jan 24 16:41:41.159367 dv-cinder-826116-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 16:41:41.160465 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: spawned uWSGI worker 1 (pid: 113342, cores: 1) Jan 24 16:41:41.160465 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: spawned uWSGI worker 2 (pid: 113343, cores: 1) Jan 24 16:41:41.160465 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 16:41:42.950039 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:41:42.950039 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: from cryptography.utils import int_from_bytes Jan 24 16:41:42.950716 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:41:42.950716 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: from cryptography.utils import int_from_bytes Jan 24 16:41:42.950869 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:41:42.950869 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: from cryptography.utils import int_from_bytes Jan 24 16:41:42.951299 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:41:42.951299 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: from cryptography.utils import int_from_bytes Jan 24 16:41:45.518336 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:41:45.518877 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:41:45.519013 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:41:45.519374 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:41:45.519628 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:41:45.520011 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.520336 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.520658 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.520973 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.521302 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.521613 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.521932 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.522252 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.522834 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.523273 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.523594 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.523814 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:41:45.524200 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826116-1-iscsi {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.524281 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:41:45.524357 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.524529 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.524634 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:41:45.524843 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.524954 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:41:45.525141 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:41:45.525227 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.525458 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.525550 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.525779 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.525875 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.526086 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.526177 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.526462 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.526566 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.526820 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527041 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527155 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527348 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527462 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527657 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527770 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.527990 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528134 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528306 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528439 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528616 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528753 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.528933 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529070 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826116-1-iscsi {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529239 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529371 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529548 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529681 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529853 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.529986 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530168 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530300 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826116-1-iscsi {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530476 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530606 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530863 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.530993 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.531167 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.531295 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.531580 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.531709 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.531889 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532009 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532195 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532341 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532513 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532641 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532834 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.532959 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533142 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533281 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533465 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533590 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533780 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.533906 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534086 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534296 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534442 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534565 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534694 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.534876 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535003 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535132 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826116-1-iscsi {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535304 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535440 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535621 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535756 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.535925 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536059 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536228 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536406 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536541 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536718 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.536845 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537025 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537152 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537346 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537475 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537667 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537799 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.537926 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538085 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538214 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538467 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538595 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538814 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.538958 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539124 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539251 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539430 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539558 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539735 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.539870 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540039 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540166 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540343 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540470 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540647 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540785 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.540955 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541083 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541258 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541355 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541572 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541671 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541881 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.541974 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542197 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542282 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542506 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542604 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542840 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.542929 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543095 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543234 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.117 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543334 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543482 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.117 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543650 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543787 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.543972 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544122 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544282 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544437 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544592 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544745 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.544899 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545125 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545276 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545402 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545525 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545678 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545812 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.545983 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546111 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546286 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546414 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546602 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546737 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.546964 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547093 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547291 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547418 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547548 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547680 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547810 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.547942 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548110 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548309 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.117 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548436 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548571 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.117 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548716 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.548842 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549019 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549181 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549315 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549501 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549633 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549813 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.549948 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550135 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550269 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550456 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550584 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550798 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.550927 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551078 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551268 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551409 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551539 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551693 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.551819 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552033 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552170 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552339 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552465 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552594 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552724 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.552875 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.553010 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.553181 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.553314 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.553498 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.553632 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.554425 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.554576 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.554740 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555084 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555231 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555433 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555561 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555697 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555821 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.555996 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556123 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556301 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556430 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556606 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556743 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.556922 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557049 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557227 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557361 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557533 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557661 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557841 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.557973 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558139 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558273 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558445 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558573 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558787 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.558930 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559087 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559227 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559394 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559521 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559699 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559824 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.559998 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560202 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560335 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560465 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560598 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560721 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.560873 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561009 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561174 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561386 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561520 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561654 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561784 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.561924 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562085 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562212 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562391 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562518 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562695 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.562853 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.563021 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.563146 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.563341 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.563468 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.563676 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.564006 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.564133 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.564317 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.564480 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.564644 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.564781 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.564956 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.565083 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.565265 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.565410 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.565573 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.565713 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.565880 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.566007 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.566188 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.566314 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.566493 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.566628 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.566827 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.566957 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.567136 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.567262 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.567437 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.567565 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.567752 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.567879 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.568071 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.568199 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.568378 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.568504 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.568685 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.568845 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.568992 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.569126 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.569323 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.570072 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:41:45.570277 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.570603 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.570727 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.570962 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571104 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571290 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571531 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571660 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571782 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.571913 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572040 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572257 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572429 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572561 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572686 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.572886 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573026 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573199 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573328 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573521 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573652 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573834 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.573963 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574146 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574274 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574458 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574602 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574802 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.574933 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575117 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575245 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575434 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575568 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575750 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.575876 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576066 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576190 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576382 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576508 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576687 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576813 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.576994 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577120 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577300 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577440 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577610 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577739 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.577915 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578049 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578234 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578372 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578557 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578685 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.578895 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579023 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579222 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579360 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579528 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579653 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579840 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.579966 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580149 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580284 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580486 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580616 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580761 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.580886 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581072 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581207 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581382 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581525 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581714 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581840 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.581982 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582115 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582289 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582417 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582593 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582728 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.582956 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583091 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583215 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583346 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583528 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583658 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583838 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.583965 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584146 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584273 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584455 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584589 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584767 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.584895 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.585122 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.585265 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.585435 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.585755 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.585917 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586084 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586213 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586415 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586542 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586724 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.586902 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587072 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587199 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587386 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587513 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587700 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.587835 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588006 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588141 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588316 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588451 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588618 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588746 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.588924 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589050 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589228 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589364 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589539 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589676 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589844 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.589980 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590150 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590284 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590452 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590578 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590773 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.590904 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591078 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591218 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591392 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591525 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591768 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.591904 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592039 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592163 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592533 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592664 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592839 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.592973 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593182 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593312 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593489 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593615 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593816 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.593941 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594142 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594277 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594460 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594587 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594781 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.594910 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595101 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595239 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595407 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595535 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595715 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.595843 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596022 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596154 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596330 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596463 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596633 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596767 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.596941 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597068 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597246 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597373 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597557 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597692 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597861 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.597988 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598178 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598306 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598483 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598618 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598816 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.598945 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599123 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599259 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599427 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599553 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599762 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.599888 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600068 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600194 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600394 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600546 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600753 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.600928 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.601065 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.601365 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.601658 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.601854 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602140 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602269 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602269 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602537 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602673 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.602882 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603099 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603227 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603431 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603560 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603758 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.603887 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604080 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604207 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604387 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604521 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604706 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.604835 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605009 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605137 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605326 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605462 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605739 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.605882 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606007 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606130 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606253 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606384 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606558 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606709 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.606894 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607030 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607205 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607346 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607517 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607650 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607829 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.607963 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608135 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608264 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608439 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608573 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608749 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.608879 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609065 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609200 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609375 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609504 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609685 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609812 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.609987 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610114 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610297 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610429 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610601 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610795 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.610938 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611063 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611223 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611352 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611535 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611671 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611857 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.611984 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612165 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612298 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612471 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612676 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612810 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.612935 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613065 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613189 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613368 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613503 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613690 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.613818 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614000 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614128 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614306 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614442 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614610 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614738 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.614940 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615069 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615253 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615393 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615569 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615696 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.615898 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.616023 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.616686 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.616819 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617073 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617239 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617376 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617614 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617749 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.617927 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618054 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618237 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618364 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618557 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618695 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.618890 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619026 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619193 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619325 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619504 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619640 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619813 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.619941 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620123 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620250 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620433 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620562 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620745 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.620870 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621051 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621176 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621361 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621490 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621669 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621796 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.621973 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622108 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622283 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622414 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622598 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622726 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.622931 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623189 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623330 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623521 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623656 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623836 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.623963 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624153 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624281 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624455 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624581 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624774 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.624900 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625094 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625227 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625407 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625535 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625720 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.625853 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626030 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626175 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626338 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626476 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626639 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626811 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.626985 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627115 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627294 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627421 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627596 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627732 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.627900 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628026 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628205 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628332 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628512 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628652 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628817 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.628944 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629131 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629257 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629443 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629583 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629743 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.629880 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630048 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630175 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630348 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630473 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630658 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630821 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.630986 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.631241 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.631368 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.631576 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.631714 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.632434 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.632646 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.632781 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633060 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633195 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633406 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633535 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633714 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.633842 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634051 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634187 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634379 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634508 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634718 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.634863 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635056 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635194 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635362 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635489 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635671 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635796 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.635982 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636132 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636324 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636442 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636565 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636687 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.636873 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.637001 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.637177 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.637752 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.637752 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638004 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638137 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638263 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638386 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638509 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638631 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638786 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.638935 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639146 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639274 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639404 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639528 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639651 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639781 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.639913 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640044 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640175 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640329 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640455 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640577 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640709 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640839 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.640970 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641093 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641216 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641339 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641469 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641593 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641716 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.641905 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642040 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642211 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642341 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642527 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642663 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642870 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.642999 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643178 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643314 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643483 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643602 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643794 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.643921 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644106 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644234 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644411 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644538 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644731 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.644867 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645040 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645176 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645344 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645473 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645646 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645784 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.645952 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646078 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646256 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646464 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646584 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646716 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.646880 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647003 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647174 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647301 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647515 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647659 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.647818 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648085 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648212 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648416 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648551 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648717 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.648844 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649022 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649149 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649328 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649463 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649628 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649755 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.649929 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650056 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650229 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650369 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650535 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650665 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650862 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.650991 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651182 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651322 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651488 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651615 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651795 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.651928 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652098 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652233 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652402 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652530 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652712 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.652838 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653020 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653155 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653347 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653481 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653660 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653798 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.653968 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654097 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654277 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654404 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654586 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654712 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.654912 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655037 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655211 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655339 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655523 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655648 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655840 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.655978 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656152 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656273 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656509 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656659 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656785 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.656907 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657052 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657187 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657355 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657490 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657663 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657797 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.657970 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658097 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658270 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658405 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658583 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658717 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.658915 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659043 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659222 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659362 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659529 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659654 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659838 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.659965 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660147 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660282 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660452 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660577 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660757 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.660883 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661060 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661194 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661369 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661495 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661680 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661815 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.661990 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662118 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662299 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662428 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662605 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662732 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.662939 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.663097 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.663320 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.663630 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.663756 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.663955 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664091 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664267 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664408 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664574 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664701 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.664885 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665014 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665191 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665319 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665508 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665636 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665814 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.665942 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.666125 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.666250 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.666453 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.666602 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.666896 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667034 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667166 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667290 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667413 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667545 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667712 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.667840 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668040 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668167 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668350 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668486 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668655 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668783 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.668966 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669093 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669278 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669414 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669594 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669729 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.669907 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670035 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670222 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670358 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670537 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670672 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.670869 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671008 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671197 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671332 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671502 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671629 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671807 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.671934 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672112 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672240 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672432 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672560 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672737 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.672865 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673058 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673186 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673366 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673498 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673673 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673801 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.673986 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674121 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674298 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674462 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674611 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674797 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.674930 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675113 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675362 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675489 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675679 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675819 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.675994 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676122 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676304 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676430 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676617 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676753 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.676954 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677082 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677234 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677369 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677550 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677686 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677858 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.677984 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.678172 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.678306 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.678478 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.678606 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.679385 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.679535 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.679713 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680032 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680168 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680355 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680489 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680669 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680798 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.680989 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681126 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681319 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681447 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681630 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681759 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.681941 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682083 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682251 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682378 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682571 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682697 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.682907 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683045 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683215 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683343 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683522 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683649 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683842 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.683970 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684147 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684276 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684459 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684636 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684778 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.684951 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685090 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685265 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685393 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685599 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685737 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.685902 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686040 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686233 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686363 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686543 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686678 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.686881 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687106 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687243 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687374 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687499 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687623 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687808 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.687935 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688117 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688254 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688430 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688557 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688735 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.688862 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689037 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689172 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689343 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689481 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689679 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689805 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.689983 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.690109 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.690307 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.690434 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.690638 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.690882 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691010 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691145 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691284 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691423 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691606 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691736 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.691932 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692059 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692251 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692385 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692567 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692693 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.692873 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693006 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693184 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693326 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693491 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693619 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693799 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.693925 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.694101 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.694235 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.694519 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.694694 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.694868 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695182 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695327 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695491 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695628 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695801 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.695931 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696106 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696244 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696429 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696557 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696735 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.696872 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697071 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697272 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697400 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697551 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697684 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697808 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.697932 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698063 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698232 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698360 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698575 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698710 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.698904 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699036 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699230 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699356 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699548 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699679 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.699871 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700001 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700191 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700317 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700499 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700619 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700823 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.700952 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701139 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701267 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701450 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701575 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701760 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.701887 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702074 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702203 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702386 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702526 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702698 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.702845 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703037 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703165 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703343 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703481 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703652 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703780 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.703963 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704096 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704267 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704402 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704573 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704779 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.704907 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705110 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705239 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705426 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705556 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705744 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.705872 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706046 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706181 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706354 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706481 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706660 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706841 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.706993 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707134 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707308 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707429 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707611 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707712 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.707917 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708031 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708224 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708329 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708549 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708646 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708858 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.708954 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.709190 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.709286 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.709506 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.709601 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.709817 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.710398 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.710698 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.710851 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.710979 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.711267 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.711367 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.711598 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.711686 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.711920 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712008 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712233 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712320 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712549 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712642 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712859 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.712945 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713172 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713267 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713483 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713570 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713796 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.713884 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714105 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714192 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714419 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714518 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714726 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.714828 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715060 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715158 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715371 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715571 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715694 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.715903 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716026 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716221 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716352 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716536 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716665 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716852 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.716976 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.717166 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.717558 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.717738 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718050 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718146 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718364 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718456 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718673 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.718787 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719024 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719121 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719348 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719442 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719663 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719750 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.719981 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720076 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720305 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720392 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720612 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720698 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.720922 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721030 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721230 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721317 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721538 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721635 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721842 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.721930 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722163 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722249 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722471 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722566 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722792 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.722895 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723119 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723215 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723426 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723527 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723737 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.723951 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724038 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724296 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724411 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724614 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724709 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.724937 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.725025 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.725248 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.725342 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.726097 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.726196 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.726438 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.726651 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.726771 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727077 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727168 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727384 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727479 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727701 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.727801 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728013 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728101 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728320 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728407 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728626 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728721 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.728936 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729181 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729275 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729504 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729598 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729833 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.729928 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730138 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730225 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730463 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730550 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730796 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.730888 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731094 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731183 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731399 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731495 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731710 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.731796 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732015 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732100 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732317 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732411 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732622 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732708 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.732923 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733007 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733231 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733325 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733534 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733620 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733834 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.733920 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.734135 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.734228 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.734444 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.734537 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.734757 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735007 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735109 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735357 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735450 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735674 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735768 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.735981 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736078 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736291 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736377 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736604 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736691 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.736908 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737187 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737286 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737366 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737524 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737619 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737826 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.737924 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.738144 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.738232 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.738458 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.738544 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.738793 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739057 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739145 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739392 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739478 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739702 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.739800 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740008 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740096 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740318 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740413 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740625 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740724 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.740931 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.741017 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.741329 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.741463 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.741828 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.741924 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742196 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742285 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742516 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742604 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742851 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.742954 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743164 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743252 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743475 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743562 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743779 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.743866 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744087 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744184 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744392 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744490 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744700 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.744789 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745005 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745092 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745319 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745421 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745622 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745708 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.745932 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746020 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746236 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746331 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746560 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746648 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746890 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.746979 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747199 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747298 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747508 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747594 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747816 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.747942 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748123 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748219 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748439 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748536 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748747 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.748840 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749065 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749152 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749371 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749458 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749789 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.749965 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750102 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750304 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750421 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750630 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750724 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.750996 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751097 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751334 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751424 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751644 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751731 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.751954 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752043 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752263 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752350 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752573 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752659 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752888 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.752983 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753202 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753289 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753513 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753602 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753824 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.753928 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754136 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754223 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754439 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754525 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754786 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.754887 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755076 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755174 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755386 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755480 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755696 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.755783 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756012 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756100 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756336 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756429 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756648 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756737 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.756994 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.757082 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.757305 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.757568 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.757671 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.757892 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758030 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758208 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758315 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758524 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758619 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758862 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.758954 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759173 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759269 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759485 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759571 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759797 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.759888 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760108 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760211 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760410 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760504 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760718 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.760831 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761043 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761138 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761368 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761467 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761673 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761760 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.761998 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762086 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762314 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762401 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762632 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762718 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.762970 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763060 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763281 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763368 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763596 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763690 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763901 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.763998 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764214 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764301 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764524 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764618 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764834 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.764962 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765148 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765235 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765459 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765554 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765766 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.765853 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766076 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766170 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766402 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766497 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766726 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.766871 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767066 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767153 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767391 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767490 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767699 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.767792 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768023 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768146 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768379 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768474 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768644 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768739 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.768948 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.769052 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.769187 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:41:45.769276 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.769570 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.769902 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.770216 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.770528 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.770864 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.771177 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.771490 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.771875 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.772206 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.773145 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.773543 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.773923 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.774248 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.774571 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.774915 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.775233 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.775702 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.776025 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.776344 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.776656 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.776968 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.777285 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.777602 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.777929 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.778255 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.778582 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.778936 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.779283 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.779599 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.779947 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.780274 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.780592 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.780906 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.781213 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:41:45.781454 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:41:45.794481 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:45.805214 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_db.sqlalchemy.engines [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:45.857386 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.context [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3bdf354a-4c6c-4cd0-9468-d050de816b3f(cell1) {{(pid=113342) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 16:41:45.861546 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:41:45.863179 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:41:45.863985 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:41:45.865923 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:41:45.868235 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.context [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3bdf354a-4c6c-4cd0-9468-d050de816b3f(cell1) {{(pid=113343) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 16:41:45.872684 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:41:45.874300 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:41:45.875159 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:41:45.876467 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:45.877290 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:41:45.879153 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:45.890945 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_db.sqlalchemy.engines [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:45.893846 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_db.sqlalchemy.engines [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:46.036265 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:46.052200 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_db.sqlalchemy.engines [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:41:46.379635 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:41:46.387099 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:41:46.390829 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: WARNING keystonemiddleware.auth_token [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:41:46.398848 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: WARNING keystonemiddleware.auth_token [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:41:46.737369 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:41:46.743486 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:41:46.748774 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8a68b39c0 pid: 113342 (default app) Jan 24 16:41:46.750881 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:41:46.752059 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] 10.222.0.117 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001788 Jan 24 16:41:46.752467 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 1/1] 10.222.0.117 () {50 vars in 793 bytes} [Mon Jan 24 16:41:46 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:41:46.773530 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: WARNING keystonemiddleware.auth_token [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:41:46.779005 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: WARNING keystonemiddleware.auth_token [None req-c924239f-2612-43a3-9e96-0c1b164ec31a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:41:46.784405 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8a68b39c0 pid: 113343 (default app) Jan 24 16:43:12.228793 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:12.229807 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Jan 24 16:43:12.230369 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 2/2] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:12.653509 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-010a1bf9-265b-408a-aa60-57aa8d43ceec admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:12.684817 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-010a1bf9-265b-408a-aa60-57aa8d43ceec admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.447577 Jan 24 16:43:12.685480 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 1/3] 10.222.0.117 () {60 vars in 1296 bytes} [Mon Jan 24 16:43:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:14.976443 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:14.977450 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f986c62b-4209-4e41-88ad-953919fe6b4e None None] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001421 Jan 24 16:43:14.977850 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 3/4] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:15.042094 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-dd90dd4d-e0ad-4d9b-9f86-0ad9e4567390 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "disk": 1, "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:15.061641 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:43:15.061641 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:43:15.093036 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-dd90dd4d-e0ad-4d9b-9f86-0ad9e4567390 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.109319 Jan 24 16:43:15.093822 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 2/5] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:15.321405 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-2ee11191-d865-4ead-b690-cc71925182b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:15.324566 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:43:15.324566 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: warnings.warn(msg) Jan 24 16:43:15.375762 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-2ee11191-d865-4ead-b690-cc71925182b4 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.269040 Jan 24 16:43:15.384768 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 4/6] 10.222.0.117 () {64 vars in 1340 bytes} [Mon Jan 24 16:43:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:17.711060 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-dd90dd4d-e0ad-4d9b-9f86-0ad9e4567390 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:17.712067 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-dd90dd4d-e0ad-4d9b-9f86-0ad9e4567390 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 Jan 24 16:43:17.712530 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 3/7] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:17.825063 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-9dd6151a-2a2e-4122-ba31-abcca74f889e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5, "id": "d1"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:17.843000 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:43:17.843000 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: warnings.warn(msg) Jan 24 16:43:17.863821 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-9dd6151a-2a2e-4122-ba31-abcca74f889e admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144928 Jan 24 16:43:17.864379 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 5/8] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:17.875767 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-fdcc785a-459b-4f05-aa4b-369d802d5382 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:17.878840 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:43:17.878840 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:43:17.927042 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-fdcc785a-459b-4f05-aa4b-369d802d5382 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054709 Jan 24 16:43:17.928645 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 4/9] 10.222.0.117 () {64 vars in 1340 bytes} [Mon Jan 24 16:43:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:20.216259 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-9dd6151a-2a2e-4122-ba31-abcca74f889e admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:20.217268 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-9dd6151a-2a2e-4122-ba31-abcca74f889e admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Jan 24 16:43:20.218518 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 6/10] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:20 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:20.280453 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-cb53b954-7f64-412e-affb-0e82785424aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G", "id": "d2", "ram": 1024, "disk": 10}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:20.300683 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-cb53b954-7f64-412e-affb-0e82785424aa admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075970 Jan 24 16:43:20.301363 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 5/11] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:43:20.313089 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-33eec242-5d84-4e20-9e60-3e5144227d6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:20.340909 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-33eec242-5d84-4e20-9e60-3e5144227d6d admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031621 Jan 24 16:43:20.346902 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 7/12] 10.222.0.117 () {64 vars in 1340 bytes} [Mon Jan 24 16:43:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:43:22.616473 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-cb53b954-7f64-412e-affb-0e82785424aa admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:22.617491 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-cb53b954-7f64-412e-affb-0e82785424aa admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001443 Jan 24 16:43:22.617899 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 6/13] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:22.678382 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-12bed4dc-a63f-4282-a9b8-14eb7b444bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:22.697472 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-12bed4dc-a63f-4282-a9b8-14eb7b444bf4 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073790 Jan 24 16:43:22.698030 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 8/14] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:22.709836 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-5c758fb6-1cfe-4523-9154-9be015a93305 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:22.733291 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-5c758fb6-1cfe-4523-9154-9be015a93305 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027008 Jan 24 16:43:22.733872 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 7/15] 10.222.0.117 () {64 vars in 1340 bytes} [Mon Jan 24 16:43:22 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:25.025583 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-12bed4dc-a63f-4282-a9b8-14eb7b444bf4 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:25.026592 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-12bed4dc-a63f-4282-a9b8-14eb7b444bf4 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 Jan 24 16:43:25.027283 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 9/16] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:25 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:25.087792 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:25.106797 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074067 Jan 24 16:43:25.107610 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 8/17] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:25.120099 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-ef37fbf0-bdbb-4414-8e82-6412cd66ff56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:25.149202 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-ef37fbf0-bdbb-4414-8e82-6412cd66ff56 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033101 Jan 24 16:43:25.150079 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 10/18] 10.222.0.117 () {64 vars in 1340 bytes} [Mon Jan 24 16:43:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:27.505009 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:27.506010 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001424 Jan 24 16:43:27.506412 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 9/19] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:27 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:27.569531 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-8f49df7e-7979-486f-912c-48051c0c2458 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:27.593455 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-8f49df7e-7979-486f-912c-48051c0c2458 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.080634 Jan 24 16:43:27.595070 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 11/20] 10.222.0.117 () {60 vars in 1296 bytes} [Mon Jan 24 16:43:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:43:30.452743 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:30.454372 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-f015d229-30dc-457f-9807-0a4850d39129 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001461 Jan 24 16:43:30.454807 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 10/21] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:30.515052 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-663aeade-a738-4659-934c-682f07642954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "ram": 512, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:30.535133 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-663aeade-a738-4659-934c-682f07642954 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074287 Jan 24 16:43:30.535724 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 12/22] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:30.550102 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-d2d17c38-eddf-4da0-bfd0-946647e2475b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:30.576431 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-d2d17c38-eddf-4da0-bfd0-946647e2475b admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032308 Jan 24 16:43:30.577011 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 11/23] 10.222.0.117 () {64 vars in 1337 bytes} [Mon Jan 24 16:43:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:32.891631 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-663aeade-a738-4659-934c-682f07642954 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:32.892646 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-663aeade-a738-4659-934c-682f07642954 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001554 Jan 24 16:43:32.893051 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 13/24] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:32 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:32.954090 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-c4d0cd81-cb0f-4917-a821-39548aa2753d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:32.973275 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-c4d0cd81-cb0f-4917-a821-39548aa2753d admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.074444 Jan 24 16:43:32.974046 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 12/25] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:43:32.986809 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-5529e302-6ccc-440a-a51d-1065e5ce1a16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:33.009112 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-5529e302-6ccc-440a-a51d-1065e5ce1a16 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026067 Jan 24 16:43:33.009682 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 14/26] 10.222.0.117 () {64 vars in 1337 bytes} [Mon Jan 24 16:43:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:35.420493 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-c4d0cd81-cb0f-4917-a821-39548aa2753d admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:35.421548 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-c4d0cd81-cb0f-4917-a821-39548aa2753d admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001520 Jan 24 16:43:35.422520 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 13/27] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:35 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:35.487855 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-07232d61-def4-4057-ab76-78b7493b1580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "id": "3"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:35.506634 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-07232d61-def4-4057-ab76-78b7493b1580 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078115 Jan 24 16:43:35.507224 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 15/28] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:35.519151 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-c1332f75-1df6-42a5-b146-cd0981aa474c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:35.542324 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-c1332f75-1df6-42a5-b146-cd0981aa474c admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027139 Jan 24 16:43:35.543345 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 14/29] 10.222.0.117 () {64 vars in 1337 bytes} [Mon Jan 24 16:43:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:43:37.830319 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-07232d61-def4-4057-ab76-78b7493b1580 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:37.839643 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-07232d61-def4-4057-ab76-78b7493b1580 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.009525 Jan 24 16:43:37.840214 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 16/30] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:37 2022] GET /compute/v2.1 => generated 389 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:43:37.913533 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-c94a205b-ce44-4869-a528-13404ea860ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "swap": 0, "name": "m1.large"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:37.932205 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-c94a205b-ce44-4869-a528-13404ea860ef admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.085232 Jan 24 16:43:37.932996 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 15/31] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:43:37.945829 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-016eca6f-307d-4487-9f6f-6eb25bbec5b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:37.971191 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-016eca6f-307d-4487-9f6f-6eb25bbec5b5 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029404 Jan 24 16:43:37.971942 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 17/32] 10.222.0.117 () {64 vars in 1337 bytes} [Mon Jan 24 16:43:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:43:40.284670 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-c94a205b-ce44-4869-a528-13404ea860ef admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:43:40.285673 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-c94a205b-ce44-4869-a528-13404ea860ef admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001442 Jan 24 16:43:40.286335 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 16/33] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:43:40 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:43:40.350530 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:40.370386 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.078145 Jan 24 16:43:40.379055 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 18/34] 10.222.0.117 () {64 vars in 1287 bytes} [Mon Jan 24 16:43:40 2022] POST /compute/v2.1/flavors => generated 410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:43:40.383485 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-cde85443-dba5-454b-9028-f88eb16835bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:43:40.410161 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-cde85443-dba5-454b-9028-f88eb16835bc admin admin] 10.222.0.117 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030122 Jan 24 16:43:40.410778 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 17/35] 10.222.0.117 () {64 vars in 1337 bytes} [Mon Jan 24 16:43:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:44:03.089142 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:03.090147 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001417 Jan 24 16:44:03.090549 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 19/36] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:44:03 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:03.148128 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-302e7119-6e00-474d-8712-8ef5eb70ec3e admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:03.164661 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-302e7119-6e00-474d-8712-8ef5eb70ec3e admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.068097 Jan 24 16:44:03.165183 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 18/37] 10.222.0.117 () {60 vars in 1296 bytes} [Mon Jan 24 16:44:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:44:04.547838 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:04.548821 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-46b9f994-4495-4e9a-9ea4-1124164c595f admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001393 Jan 24 16:44:04.549220 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 20/38] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:04.752174 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-6b833eb8-d61c-47b1-b534-115fd73e2441 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:04.757683 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.wsgi [None req-6b833eb8-d61c-47b1-b534-115fd73e2441 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 16:44:04.758196 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-6b833eb8-d61c-47b1-b534-115fd73e2441 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:04.759017 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-6b833eb8-d61c-47b1-b534-115fd73e2441 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058238 Jan 24 16:44:04.759529 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 19/39] 10.222.0.117 () {60 vars in 1195 bytes} [Mon Jan 24 16:44:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 16:44:04.769152 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-75a0b997-3556-423e-a3d9-49bb32af64cf admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:04.789707 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-75a0b997-3556-423e-a3d9-49bb32af64cf admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.023989 Jan 24 16:44:04.790260 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 21/40] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:44:04.800030 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-89cfc428-b2e5-4608-9219-5d5c2c79f14c admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:04.821169 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-89cfc428-b2e5-4608-9219-5d5c2c79f14c admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024534 Jan 24 16:44:04.821713 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 20/41] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:44:04.830885 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-551b0a19-1815-4e4f-bed1-80327b182e43 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:04.836722 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-551b0a19-1815-4e4f-bed1-80327b182e43 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 24 16:44:04.837288 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-551b0a19-1815-4e4f-bed1-80327b182e43 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:04.838071 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-551b0a19-1815-4e4f-bed1-80327b182e43 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010707 Jan 24 16:44:04.838568 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 22/42] 10.222.0.117 () {60 vars in 1195 bytes} [Mon Jan 24 16:44:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:06.131902 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-89cfc428-b2e5-4608-9219-5d5c2c79f14c admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:06.132914 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-89cfc428-b2e5-4608-9219-5d5c2c79f14c admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001795 Jan 24 16:44:06.133320 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 21/43] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:06 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:06.352950 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dab8ab5d-931c-4b6c-8f0b-f7b401a7a847 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:06.358667 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-dab8ab5d-931c-4b6c-8f0b-f7b401a7a847 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 16:44:06.359514 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dab8ab5d-931c-4b6c-8f0b-f7b401a7a847 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:06.360297 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dab8ab5d-931c-4b6c-8f0b-f7b401a7a847 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066997 Jan 24 16:44:06.360801 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 23/44] 10.222.0.117 () {60 vars in 1195 bytes} [Mon Jan 24 16:44:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:06.369836 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-5743e55b-4949-4a80-b6b2-7e3f856efeb9 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:06.384366 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-5743e55b-4949-4a80-b6b2-7e3f856efeb9 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017953 Jan 24 16:44:06.384919 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 22/45] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:44:06.395038 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-92eafb02-bb71-4f7f-9093-4a412bda813a admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:06.412525 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-92eafb02-bb71-4f7f-9093-4a412bda813a admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.021047 Jan 24 16:44:06.413082 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 24/46] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:44:06.425052 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-6483ed9c-bd17-42f8-bad4-da18f651ca86 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:06.430717 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.wsgi [None req-6483ed9c-bd17-42f8-bad4-da18f651ca86 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 24 16:44:06.431298 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-6483ed9c-bd17-42f8-bad4-da18f651ca86 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:06.432157 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-6483ed9c-bd17-42f8-bad4-da18f651ca86 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011208 Jan 24 16:44:06.432754 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 23/47] 10.222.0.117 () {60 vars in 1195 bytes} [Mon Jan 24 16:44:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 16:44:07.726976 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-92eafb02-bb71-4f7f-9093-4a412bda813a admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:07.727973 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-92eafb02-bb71-4f7f-9093-4a412bda813a admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001440 Jan 24 16:44:07.728365 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 25/48] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:07 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:07.935182 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-a15f9773-90c6-425c-959f-25818e9f1e86 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:07.940426 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.wsgi [None req-a15f9773-90c6-425c-959f-25818e9f1e86 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 16:44:07.940985 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-a15f9773-90c6-425c-959f-25818e9f1e86 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:07.941764 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-a15f9773-90c6-425c-959f-25818e9f1e86 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.070862 Jan 24 16:44:07.942269 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 24/49] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:44:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 24 16:44:07.951222 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-90456596-c954-4602-99cb-6fad9e28da38 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:07.964607 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-90456596-c954-4602-99cb-6fad9e28da38 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.016810 Jan 24 16:44:07.965122 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 26/50] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:44:07.975207 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:07.988927 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017531 Jan 24 16:44:07.989822 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 25/51] 10.222.0.117 () {60 vars in 1215 bytes} [Mon Jan 24 16:44:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:44:08.002081 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-6ca2f3eb-7032-4f21-827e-fff5b8b53974 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:08.007376 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-6ca2f3eb-7032-4f21-827e-fff5b8b53974 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 24 16:44:08.007928 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-6ca2f3eb-7032-4f21-827e-fff5b8b53974 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:44:08.008698 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-6ca2f3eb-7032-4f21-827e-fff5b8b53974 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010099 Jan 24 16:44:08.009193 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 27/52] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:44:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 24 16:44:09.298863 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:09.299848 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001418 Jan 24 16:44:09.300239 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 26/53] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:09 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:09.494488 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-68c0aea3-2997-413d-b096-5f1a9ff63424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:44:09.512697 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-68c0aea3-2997-413d-b096-5f1a9ff63424 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.069258 Jan 24 16:44:09.513953 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 28/54] 10.222.0.117 () {64 vars in 1240 bytes} [Mon Jan 24 16:44:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:44:10.789669 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:10.790657 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001384 Jan 24 16:44:10.791114 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 27/55] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:10.986783 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-b5ea670d-d01c-4656-8541-043bb92a305f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:44:11.004055 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-b5ea670d-d01c-4656-8541-043bb92a305f admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067632 Jan 24 16:44:11.004546 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 29/56] 10.222.0.117 () {64 vars in 1240 bytes} [Mon Jan 24 16:44:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:44:12.288827 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:12.289886 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001498 Jan 24 16:44:12.290338 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 28/57] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:12.494631 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-51763dbc-3978-4ca1-9ebd-f80052db7f5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:44:12.514315 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-51763dbc-3978-4ca1-9ebd-f80052db7f5e admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074437 Jan 24 16:44:12.514898 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 30/58] 10.222.0.117 () {64 vars in 1240 bytes} [Mon Jan 24 16:44:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:44:13.816904 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:13.817911 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001413 Jan 24 16:44:13.818346 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 29/59] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:14.011964 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-e326e092-d0c7-4ae6-9a29-8f1af7687f88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:44:14.029874 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-e326e092-d0c7-4ae6-9a29-8f1af7687f88 admin admin] 10.222.0.117 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.070107 Jan 24 16:44:14.030352 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 31/60] 10.222.0.117 () {64 vars in 1240 bytes} [Mon Jan 24 16:44:13 2022] POST /compute/v2.1/flavors => generated 411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:44:15.301104 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:15.302077 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001390 Jan 24 16:44:15.302473 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 30/61] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:44:15 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:44:15.494639 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-959f26c5-b35c-4d07-b83b-d0445639f488 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:44:15.513553 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-959f26c5-b35c-4d07-b83b-d0445639f488 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.072242 Jan 24 16:44:15.514090 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 32/62] 10.222.0.117 () {60 vars in 1207 bytes} [Mon Jan 24 16:44:15 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:45:03.065750 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.066740 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-3d1cbd7f-a2a6-40d0-8284-61f778c178a7 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001410 Jan 24 16:45:03.067160 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 31/63] 10.222.0.117 () {54 vars in 935 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:45:03.124145 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-ef1900a9-7613-45ed-9f4d-ba08a264e0d1 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.144202 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-ef1900a9-7613-45ed-9f4d-ba08a264e0d1 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.071210 Jan 24 16:45:03.144734 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 33/64] 10.222.0.117 () {60 vars in 1296 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:45:03.166788 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-92d401f8-498a-4844-b01f-c5722534858c admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.174439 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-92d401f8-498a-4844-b01f-c5722534858c admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011175 Jan 24 16:45:03.174992 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 32/65] 10.222.0.117 () {60 vars in 1287 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:45:03.185785 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-c8de8c98-1a85-49c2-92a5-bc4ff35bd21f admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.193274 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-c8de8c98-1a85-49c2-92a5-bc4ff35bd21f admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010945 Jan 24 16:45:03.193774 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 34/66] 10.222.0.117 () {60 vars in 1290 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:45:03.204992 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-09e07b63-94f3-4612-8033-651ee00f8882 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.212612 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-09e07b63-94f3-4612-8033-651ee00f8882 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010980 Jan 24 16:45:03.213115 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 33/67] 10.222.0.117 () {60 vars in 1290 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:45:03.224206 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:45:03.232093 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] 10.222.0.117 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011258 Jan 24 16:45:03.232602 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 35/68] 10.222.0.117 () {60 vars in 1287 bytes} [Mon Jan 24 16:45:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:46:51.117396 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-76570618-e15c-4a1a-a7f2-d515a6c80453 tempest-verify_tempest_config-1704091501 tempest-verify_tempest_config-1704091501-project] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:46:51.119385 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-76570618-e15c-4a1a-a7f2-d515a6c80453 tempest-verify_tempest_config-1704091501 tempest-verify_tempest_config-1704091501-project] 10.222.0.117 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106090 Jan 24 16:46:51.119910 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 34/69] 10.222.0.117 () {58 vars in 1138 bytes} [Mon Jan 24 16:46:51 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:48:25.336267 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:25.337261 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001417 Jan 24 16:48:25.337654 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 36/70] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:48:25 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:48:25.595701 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:25.596866 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:48:25.596866 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:48:25.598373 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:25.598832 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:25.599614 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:25.600032 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:25.633592 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-d3a23e06-e965-4792-9f3a-d5f63ba67196 admin admin] 10.222.0.117 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155387 Jan 24 16:48:25.634133 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 35/71] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:48:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:48:26.928315 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:26.929317 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Jan 24 16:48:26.929711 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 37/72] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:48:26 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:48:27.125274 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:27.126462 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:48:27.126462 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:48:27.128038 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:27.128599 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:27.129401 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:27.129827 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:27.149713 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-279d0d04-8b98-4d7c-845b-a6e1fdf38038 admin admin] 10.222.0.117 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076635 Jan 24 16:48:27.150199 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 36/73] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:48:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:48:38.900461 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:38.901458 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001420 Jan 24 16:48:38.901858 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 38/74] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:48:38 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:48:39.095602 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:39.096758 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:48:39.096758 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:48:39.098280 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:39.098712 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:39.099553 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:39.099980 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:39.123588 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-680a52b9-1205-4e09-8031-7aa73aa855b1 admin admin] 10.222.0.117 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079708 Jan 24 16:48:39.124058 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 37/75] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:48:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:48:40.416231 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:40.417209 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-dc892f3c-ab9c-4193-b22d-1bd5dbec81f0 admin admin] 10.222.0.117 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001388 Jan 24 16:48:40.417607 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 39/76] 10.222.0.117 () {56 vars in 1079 bytes} [Mon Jan 24 16:48:40 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:48:40.610245 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG nova.api.openstack.wsgi [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] Calling method '>' {{(pid=113343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:48:40.611466 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:48:40.611466 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: warnings.warn(msg) Jan 24 16:48:40.613014 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:40.613456 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:40.614258 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:48:40.614681 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: DEBUG oslo_concurrency.lockutils [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:48:40.636308 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: INFO nova.api.openstack.requestlog [None req-793a5001-3f22-4b91-b6c0-c70462b540e2 admin admin] 10.222.0.117 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078169 Jan 24 16:48:40.636866 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: [pid: 113343|app: 0|req: 38/77] 10.222.0.117 () {60 vars in 1198 bytes} [Mon Jan 24 16:48:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:49:38.259111 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: Mon Jan 24 16:49:38 2022 - graceful shutdown triggered... Jan 24 16:49:38.259638 dv-cinder-826116-1-iscsi devstack@n-api.service[113342]: Gracefully killing worker 1 (pid: 113342)... Jan 24 16:49:38.259997 dv-cinder-826116-1-iscsi devstack@n-api.service[113343]: Gracefully killing worker 2 (pid: 113343)... Jan 24 16:49:38.261346 dv-cinder-826116-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 24 16:49:39.259877 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: worker 1 buried after 1 seconds Jan 24 16:49:39.259877 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: worker 2 buried after 1 seconds Jan 24 16:49:39.259877 dv-cinder-826116-1-iscsi devstack@n-api.service[113341]: goodbye to uWSGI. Jan 24 16:49:39.261382 dv-cinder-826116-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 24 16:49:39.261944 dv-cinder-826116-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 24 16:49:39.265306 dv-cinder-826116-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 24 16:49:39.274920 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 24 16:49:39.277488 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 24 16:49:39 2022] *** Jan 24 16:49:39.277641 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: nodename: dv-cinder-826116-1-iscsi Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: machine: x86_64 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: clock source: unix Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: pcre jit disabled Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: detected number of CPU cores: 4 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: current working directory: / Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: detected binary path: /usr/bin/uwsgi-core Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: your processes number limit is 47680 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: your memory page size is 4096 bytes Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: detected max file descriptor number: 2048 Jan 24 16:49:39.277796 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: lock engine: pthread robust mutexes Jan 24 16:49:39.278567 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: thunder lock: enabled Jan 24 16:49:39.278567 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 24 16:49:39.278567 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 24 16:49:39.323614 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: Python main interpreter initialized at 0x5612b490c9c0 Jan 24 16:49:39.323614 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: python threads support enabled Jan 24 16:49:39.323614 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: your server socket listen backlog is limited to 100 connections Jan 24 16:49:39.323614 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: your mercy for graceful operations on workers is 90 seconds Jan 24 16:49:39.324060 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: mapped 403077 bytes (393 KB) for 2 cores Jan 24 16:49:39.324060 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: *** Operational MODE: preforking *** Jan 24 16:49:39.324340 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: *** uWSGI is running in multiple interpreter mode *** Jan 24 16:49:39.324340 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: spawned uWSGI master process (pid: 127811) Jan 24 16:49:39.324541 dv-cinder-826116-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 24 16:49:39.327048 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: spawned uWSGI worker 1 (pid: 127826, cores: 1) Jan 24 16:49:39.327048 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: spawned uWSGI worker 2 (pid: 127827, cores: 1) Jan 24 16:49:39.327048 dv-cinder-826116-1-iscsi devstack@n-api.service[127811]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 24 16:49:41.368917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:49:41.368917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: from cryptography.utils import int_from_bytes Jan 24 16:49:41.369574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:49:41.369574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: from cryptography.utils import int_from_bytes Jan 24 16:49:41.401901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:49:41.401901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: from cryptography.utils import int_from_bytes Jan 24 16:49:41.402526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 24 16:49:41.402526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: from cryptography.utils import int_from_bytes Jan 24 16:49:43.847500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:49:43.848137 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:49:43.848239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:49:43.848537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:49:43.848808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:49:43.849177 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.849508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.849834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.850157 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.850493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.850829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.851161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.851495 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.851823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.852091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.852412 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.852747 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826116-1-iscsi {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.853076 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.853391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.853713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.854040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.854352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.854680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.855030 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.855539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.856896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.856896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.857097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.857960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.858403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.858730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.859084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.859415 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.859744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.860065 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.860478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826116-1-iscsi {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.860804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.861127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.861444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.861872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.862185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.862500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.862868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.863180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.863738 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.864335 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.864899 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.865329 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.865656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.865974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.866298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.866623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.866982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.867300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.867619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.867879 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.868197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.868530 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.868866 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.869211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.869460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.869713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.870040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.870370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.870691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.871035 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.871351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.871667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.871985 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.872300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.872616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.872969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.873293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.873630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.873947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.874263 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.874591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.875026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.117 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.875283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.117 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.875598 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.875945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.876269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.876586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.876913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.877240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.877555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.877868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.878181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.878504 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.878875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.879192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.879449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.879757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.880249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.880728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.881215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.881529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.881846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.882161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.882474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.882810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.883131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.883446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.883763 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.884086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.884396 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.884711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.885118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.885349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.885679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.885996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.886311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.886633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.886959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.887288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.887717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.888037 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.888393 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.888712 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.889034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.889363 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.889680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.889994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.890321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.890630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.890970 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.891295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.891611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.891924 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.892718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.892888 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 24 16:49:43.893405 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.893580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 24 16:49:43.893727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.893727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.893997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 24 16:49:43.894160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.894299 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 24 16:49:43.894456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.894595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 24 16:49:43.894742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.894903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895075 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895664 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.895975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896134 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896590 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.896980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.897118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.897353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.897510 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.897660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.897810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.897950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.898095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.898249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.898536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826116-1-iscsi {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.898869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.899555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.899718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.899876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.900253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.900402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.900402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.900743 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.900894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.901047 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.901208 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.902087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.902279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.902428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.902428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.902906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.903071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.903235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.903388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.903540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.903540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.903841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.903982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.904647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.904819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.904959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.905096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.905236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.905236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.905527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.905675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.905825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.906076 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.906243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.906394 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.906622 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.906822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.906822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.906822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.907247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826116-1-iscsi {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.907397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.907545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.907694 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.907842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.907989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.908145 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.908294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.908432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.908582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.908730 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.909015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.909543 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.909696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.909849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.909988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.910146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.910286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.910429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.910577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.910715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.910832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.910907 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.910987 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.911113 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.911188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.911188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.911318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.911545 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.911716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.911871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.912023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.912166 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.912309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.912458 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.912612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.912765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.912968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.913224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.913383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.913537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.913697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.913870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.914016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.914161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.914304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.914448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.914606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.914779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.914940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.915096 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.915246 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.915401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.915545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.915702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.915853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.916005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.916160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.916319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.916474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.916627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.916780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.916959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.917118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.917300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.917455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.917617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.917771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.917921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.918074 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.918224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.918368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.918510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.918660 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.918834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.919073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.919223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.920967 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.921164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.921164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.921164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.921648 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.921801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.921956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.922102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.922252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.922406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.922559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.117 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.922709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.922889 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.117 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.923044 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.923251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.923487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.923647 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.923800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.923974 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.924225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.924391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.924554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.924713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.924867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.925012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.925189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.925375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.925549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.925702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.925853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.925853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.926127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.926278 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.926432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.926432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.926711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.926975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.927121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.927266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.927496 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.927661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.927805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.927949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.928099 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.928245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.928396 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.928548 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.928701 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.928845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.928996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.929230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.929391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.929852 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.930010 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.930162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.930317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.930470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.930623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.930787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.930956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.931204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.931356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.931507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.931661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.931813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.931976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.932134 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.932287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.932447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.932592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.932735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.932886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.933037 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.933227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.933386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.933626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.933782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.933935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.934095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.934239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.934398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.934543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.934695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.934875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.935038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.935182 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.935353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.935499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.935681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.935931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.936119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.936278 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.936450 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.936608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.936753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.936907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.937060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.937213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.937372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.937553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.937717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.937873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.938026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.938178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.938340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.938501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.938645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.938842 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.939003 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.939156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.939156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.939564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.939564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.940152 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.940300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.940451 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.940595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.940760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.940906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.941059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.941472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.941636 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.941782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.941942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.942095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.942241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.942385 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.942529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.942687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.942868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.943017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.943170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.943315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.943466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.943641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.943874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.944602 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.945022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.945170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 24 16:49:43.945321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.945477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.945655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.945813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.945966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946576 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.946908 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947229 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947683 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.947972 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.948948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.949096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.949249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.949431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.949700 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950785 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.950947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.951965 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.952893 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953047 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953192 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.953861 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954265 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.954968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.955870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956338 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956786 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.956937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.957081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.957308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.957474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.957775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.957949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.958952 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959089 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959595 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.959968 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960901 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.960992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961320 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961412 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.961904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962193 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962275 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962614 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.962971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963762 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.963943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964135 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964311 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964392 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964556 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.964934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965802 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.965975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.966058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.966146 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.966236 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.966319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.966415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.967887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968183 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968680 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968774 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.968993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.969955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970060 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970338 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970679 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.970908 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971004 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.971970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972274 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972490 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972802 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.972895 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973762 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.973854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.974853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975113 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975442 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975740 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.975971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976061 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976282 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976690 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.976997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.977218 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.977351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.977544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.977646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.977854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978486 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978581 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.978935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979762 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.979853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980177 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.980803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981341 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981658 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.981969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.982050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.982856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.982953 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.983175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.983312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.983492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.983692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.983801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985890 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.985973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.986910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.987118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.987225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.987429 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.987530 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.987882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988014 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.988961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989147 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989609 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.989900 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990063 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990362 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.990894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991335 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.991962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.992992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.993957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994783 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.994895 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995415 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995508 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.995820 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996455 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996669 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.996982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997083 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.997965 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.998059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.998350 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.998538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.998689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.998838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999762 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:43.999974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000407 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000709 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.000925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001371 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.001983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.002211 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.002310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.002538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.002638 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.002895 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003693 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.003971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004224 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004859 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.004969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005785 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.005884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006103 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.006836 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007050 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007371 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.007775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.008943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009755 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.009883 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.010070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.010212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.010403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.010526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.010731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.011080 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.011390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.011483 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.011708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.011799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.012994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.013094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.013313 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.013922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.014136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.014232 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.014523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.014655 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.014934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.015927 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016258 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016465 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.016869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017512 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.017800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.018982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019105 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019605 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.019918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.020939 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021155 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021602 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.021902 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.022857 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023006 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023421 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023720 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.023938 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024265 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024378 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.024991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.025895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026514 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.026958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027405 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027502 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027712 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.027803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028732 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.028946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.029889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.029889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030128 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.030784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031112 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031726 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.031960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032363 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.032985 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033502 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033593 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.033911 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.034937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035146 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035253 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035461 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035551 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.035876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036194 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036502 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036720 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.036820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037164 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.037999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.038972 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039393 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039701 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.039939 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.040914 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.041864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042085 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.042839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.043990 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.044083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.044308 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.044406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.044681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.044797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045158 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.045834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.046094 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.046294 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.046418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.046716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.046852 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047062 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047154 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.047834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.048783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.049960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050065 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.050933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051052 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051678 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051792 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.051988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052379 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.052939 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.053864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054451 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054553 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.054875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055211 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055764 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.055846 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.056855 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.057584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.057688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.057778 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.057853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.057922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058000 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058139 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058733 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.058868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.059085 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.059392 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.059485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.059713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.059795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.060031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.060203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.060444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.060536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.060779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.061840 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.062799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063135 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063350 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063794 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.063979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.064918 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.065862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.066921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067199 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067724 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.067830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068430 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068659 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.068972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.069075 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.069280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.069382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.069596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.069952 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070271 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070477 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.070911 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.071824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.072789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073430 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073650 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.073989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.074082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.074319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.074574 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.074676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.074942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.075040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.075279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.075402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.075589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.075693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.076481 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.076596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.076795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077199 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077519 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.077860 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078343 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078492 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.078826 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079063 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079358 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079455 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079597 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.079907 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080537 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080849 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.080962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081461 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081573 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.081915 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.082117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.082313 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.082457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.082797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.083161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.083345 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.083462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.083677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.083779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084637 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.084953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.085046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.085654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.085777 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.085859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.085946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086038 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086123 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.086989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087307 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.087946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088282 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.088934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089275 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.089951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090784 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.090988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.091081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.091307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.091414 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.092246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.092517 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.092618 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.092856 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.092951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.093950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094497 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.094951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.095175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.095271 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.095533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.095633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.095863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096277 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.096929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097638 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.097878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098519 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098732 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.098887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099175 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.099822 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100360 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.100998 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101105 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101428 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101638 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101843 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.101968 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102861 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.102956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.103941 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104570 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.104882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105737 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.105830 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106066 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.106840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.107045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.107174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.107428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.107532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.107687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:49:44.108038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.108400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.108727 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.109062 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.109399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.109724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.110037 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.110369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.110686 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.111023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.111348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.111667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.111981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.112289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.112607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.112923 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.113232 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.113549 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.113861 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.114192 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.114503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.114837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.115150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.115483 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.115795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.116107 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.116417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.116726 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.117043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.117353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.117669 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.117978 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.118295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.118601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.118938 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.119249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.119579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.119888 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.120198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.120520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.120836 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.121163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.121483 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.121876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.122148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.122471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.123110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.123451 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.123783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.124125 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.124462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.124778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.125091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.125406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.125739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.126058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.126377 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.126694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.127024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.127340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.127672 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.127976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.128741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.128741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.128940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.129205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.129561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.129885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.130237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.130575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.130913 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.131232 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.131460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_db.sqlalchemy.engines [None req-df764875-e357-44cd-a228-f73a57776d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.131568 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.131863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.132172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.132494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.133023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.133364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.133668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.134106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.134425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.134780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.135199 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.135419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.135810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.136072 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.136391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.136717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.137031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.137367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.137713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.138050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.138918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.139243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.139554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.139869 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.140183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.140520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.140863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.141185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.141513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.141830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.142158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.142477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.142830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.143160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.143486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.143802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.144142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.144459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.144776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.145091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.145406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.145719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.146040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.146374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.146706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.147041 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.147374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.147700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.148025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.148346 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.148663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.148996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.149312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.149639 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.149961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.150307 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.150624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.151049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.151298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.151630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.151995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.152289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.152641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.152957 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.153307 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.156372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.156372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.156372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.156372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 24 16:49:44.156372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127826) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 24 16:49:44.178086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_db.sqlalchemy.engines [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.197164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.context [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3bdf354a-4c6c-4cd0-9468-d050de816b3f(cell1) {{(pid=127827) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 16:49:44.201981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:49:44.203619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:49:44.204438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:49:44.206402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:49:44.218084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_db.sqlalchemy.engines [None req-df764875-e357-44cd-a228-f73a57776d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.218960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_db.sqlalchemy.engines [None req-df764875-e357-44cd-a228-f73a57776d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.241691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.context [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3bdf354a-4c6c-4cd0-9468-d050de816b3f(cell1) {{(pid=127826) load_cells /opt/stack/nova/nova/context.py:464}} Jan 24 16:49:44.245949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:49:44.247592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:49:44.248444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:49:44.250366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:49:44.261081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_db.sqlalchemy.engines [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.261915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_db.sqlalchemy.engines [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.379043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_db.sqlalchemy.engines [None req-df764875-e357-44cd-a228-f73a57776d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.424005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_db.sqlalchemy.engines [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127826) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 24 16:49:44.704562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: WARNING keystonemiddleware.auth_token [None req-df764875-e357-44cd-a228-f73a57776d8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:49:44.711221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: WARNING keystonemiddleware.auth_token [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:49:44.745456 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: WARNING keystonemiddleware.auth_token [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:49:44.752979 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: WARNING keystonemiddleware.auth_token [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:49:45.058375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: WARNING keystonemiddleware.auth_token [None req-df764875-e357-44cd-a228-f73a57776d8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:49:45.064559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: WARNING keystonemiddleware.auth_token [None req-df764875-e357-44cd-a228-f73a57776d8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:49:45.070390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612b490c9c0 pid: 127827 (default app) Jan 24 16:49:45.114054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: WARNING keystonemiddleware.auth_token [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 24 16:49:45.119460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: WARNING keystonemiddleware.auth_token [None req-a2248a48-8608-4150-92b1-eccdef11bbfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 24 16:49:45.125319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5612b490c9c0 pid: 127826 (default app) Jan 24 16:50:20.218274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-da002601-1b19-439d-bbf3-b9794dab059c tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Action: 'create', calling method: .version_select at 0x7fba16d7f9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-174097556", "metadata": {"Type": "work"}}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:21.804070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8a2e37a0-7918-43fe-a13a-cfe726d87f85 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Action: 'create', calling method: .version_select at 0x7fba16d7e9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-720556298"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:22.612929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-da002601-1b19-439d-bbf3-b9794dab059c tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.644581 Jan 24 16:50:22.613879 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 1/1] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:50:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3647 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 24 16:50:22.626930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-922d58d3-49ac-4adf-8813-cad79932c734 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Calling method '.version_select at 0x7fba16c4c550>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:22.825508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-922d58d3-49ac-4adf-8813-cad79932c734 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d" status: 200 len: 352 microversion: 2.1 time: 0.202536 Jan 24 16:50:22.826260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 2/2] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:22 2022] GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d => generated 352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:22.909335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8a2e37a0-7918-43fe-a13a-cfe726d87f85 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.103307 Jan 24 16:50:22.910794 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 1/3] 10.222.0.117 () {60 vars in 1159 bytes} [Mon Jan 24 16:50:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2106 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jan 24 16:50:22.925180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dec8e773-b8a0-4979-8a51-d950176a3ea4 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16d27820>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:23.028596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dec8e773-b8a0-4979-8a51-d950176a3ea4 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 200 len: 344 microversion: 2.1 time: 0.109490 Jan 24 16:50:23.029518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 3/4] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:22 2022] GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:23.839219 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-24aa3a8f-3aea-412f-94a6-bd76fd60fb3e tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Calling method '.version_select at 0x7fba16c4b550>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:23.980886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-24aa3a8f-3aea-412f-94a6-bd76fd60fb3e tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d" status: 200 len: 353 microversion: 2.1 time: 0.146111 Jan 24 16:50:23.981498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 2/5] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:23 2022] GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:23.998573 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-046e0309-ca3b-4dea-a84a-cc6bbc642269 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Calling method '.version_select at 0x7fba16c4c5e0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:24.041279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-620593b6-3906-4c6b-a3de-b40dd02b0ff7 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16c4bdc0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:24.125197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-046e0309-ca3b-4dea-a84a-cc6bbc642269 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d" status: 200 len: 353 microversion: 2.1 time: 0.136506 Jan 24 16:50:24.125831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 4/6] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:23 2022] GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:24.141693 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-620593b6-3906-4c6b-a3de-b40dd02b0ff7 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 200 len: 345 microversion: 2.1 time: 0.104002 Jan 24 16:50:24.143011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 3/7] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:24 2022] GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:24.151519 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0c84d6c2-21ab-4498-8cef-781fe226b4f0 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Calling method '.version_select at 0x7fba16c4be50>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:24.305487 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0c84d6c2-21ab-4498-8cef-781fe226b4f0 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d" status: 202 len: 0 microversion: 2.1 time: 0.161194 Jan 24 16:50:24.306392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 4/8] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:50:24 2022] DELETE /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:50:24.316591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0e587d00-2ffc-49d7-ad73-716946f91d62 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Action: 'create', calling method: .version_select at 0x7fba16be05e0>, body: {"snapshot": {"volume_id": "d7396ff7-ba66-43aa-9e7f-4c8174cacbc3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-631680062"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:24.408354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1918045993", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "d2067982-5a38-46c1-8ec9-527550d6c2b1"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:24.640824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] validate_networks() for [('d2067982-5a38-46c1-8ec9-527550d6c2b1', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:24.714252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0e587d00-2ffc-49d7-ad73-716946f91d62 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.404875 Jan 24 16:50:24.719972 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 5/9] 10.222.0.117 () {60 vars in 1166 bytes} [Mon Jan 24 16:50:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:24.724450 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a39dfb34-aefd-4219-9b6c-f6e94088d4a6 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Calling method '.version_select at 0x7fba16be0e50>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:24.810992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-a39dfb34-aefd-4219-9b6c-f6e94088d4a6 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] HTTP exception thrown: Volume 04722f14-7f23-4001-91fb-ea19e6b34f9d could not be found. Jan 24 16:50:24.811936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a39dfb34-aefd-4219-9b6c-f6e94088d4a6 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] Returning 404 to user: Volume 04722f14-7f23-4001-91fb-ea19e6b34f9d could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:50:24.812995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a39dfb34-aefd-4219-9b6c-f6e94088d4a6 tempest-VolumesGetTestJSON-1893401944 tempest-VolumesGetTestJSON-1893401944-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d" status: 404 len: 109 microversion: 2.1 time: 0.092091 Jan 24 16:50:24.814002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 6/10] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:24 2022] GET /compute/v2.1/os-volumes/04722f14-7f23-4001-91fb-ea19e6b34f9d => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:50:24.826511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5cdc15e7-22ad-4a10-a132-bb0bdb2b3116 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba175afca0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:24.887974 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5cdc15e7-22ad-4a10-a132-bb0bdb2b3116 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 200 len: 286 microversion: 2.1 time: 0.072830 Jan 24 16:50:24.888629 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 7/11] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:24 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:24.898224 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-62270163-6a59-4cf2-8a7a-6b091915cc9c tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16be0670>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:25.012147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-62270163-6a59-4cf2-8a7a-6b091915cc9c tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.115897 Jan 24 16:50:25.031209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 8/12] 10.222.0.117 () {58 vars in 1144 bytes} [Mon Jan 24 16:50:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:50:25.052156 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-101cab59-c490-4b52-8d34-af989e39add5 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16c4bdc0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:25.129571 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-101cab59-c490-4b52-8d34-af989e39add5 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 200 len: 286 microversion: 2.1 time: 0.097179 Jan 24 16:50:25.130153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 9/13] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:25 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:25.882016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: .version_select at 0x7fba16be0b80>, body: {"keypair": {"name": "tempest-keypair-623290570"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:25.976369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:25.993678 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:26.233295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:26.243637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:26.263823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fe99ac53-e292-42ae-88f9-bc69685f4645 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.993075 Jan 24 16:50:26.265630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 10/14] 10.222.0.117 () {62 vars in 1203 bytes} [Mon Jan 24 16:50:25 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 996 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:50:26.542034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-599970398", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "4fdddf37-bc88-49a0-ab52-b4d45f811b51"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:26.688185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] validate_networks() for [('4fdddf37-bc88-49a0-ab52-b4d45f811b51', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:27.185858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:27.186419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:27.187255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:27.187908 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:27.188544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:27.211310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:27.212652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:27.214368 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:27.215160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:27.249815 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:27.257246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for user feb8ddf0abd84c1caed8501c57b56f20 and project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:27.273387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:27.277758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:27.358329 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c7f44d9d-4ded-41cd-9b45-2990147e4467 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.231195 Jan 24 16:50:27.359404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 5/15] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:50:24 2022] POST /compute/v2.1/servers => generated 382 bytes in 3233 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:50:27.369087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ba3aecdf-1f80-4935-9f18-758a8c189f7b tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba162dfdc0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:27.450563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ba3aecdf-1f80-4935-9f18-758a8c189f7b tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 200 len: 286 microversion: 2.1 time: 0.089858 Jan 24 16:50:27.454480 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 6/16] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:27 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:27.458413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-da64c506-53dd-4075-bbba-f3b8f19d5cbf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:27.459830 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-da64c506-53dd-4075-bbba-f3b8f19d5cbf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:27.631726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-da64c506-53dd-4075-bbba-f3b8f19d5cbf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:27.673800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-da64c506-53dd-4075-bbba-f3b8f19d5cbf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1222 microversion: 2.1 time: 0.213922 Jan 24 16:50:27.675229 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 7/17] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:27 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1222 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:28.364031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:28.365848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:28.366410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:28.366928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:28.367599 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:28.396838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:28.397758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:28.400679 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:28.403192 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:28.467108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e3b24f67-b0f0-4ba2-a739-1eb5dd628964 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba162ecf70>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:28.505395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Getting quotas for project 8d59c94478d24e3f917829b148941337. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:28.514299 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Getting quotas for user 3b9a988ccba046e399cb0f755b9a03e1 and project 8d59c94478d24e3f917829b148941337. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:28.543427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e3b24f67-b0f0-4ba2-a739-1eb5dd628964 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 200 len: 287 microversion: 2.1 time: 0.085653 Jan 24 16:50:28.544633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 8/18] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:28 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:28.550445 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:28.562700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:28.564710 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ef7a854c-6444-437a-967e-8022e02e3e24 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16312940>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:28.746491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ef7a854c-6444-437a-967e-8022e02e3e24 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "DELETE /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 202 len: 0 microversion: 2.1 time: 0.195222 Jan 24 16:50:28.747647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 9/19] 10.222.0.117 () {58 vars in 1258 bytes} [Mon Jan 24 16:50:28 2022] DELETE /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:50:28.758367 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3f44bfc7-f129-4684-914b-2983e9f9d4f1 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:28.759156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3f44bfc7-f129-4684-914b-2983e9f9d4f1 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:28.785928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-29ded6ef-5937-40f3-ade7-ad4678444f14 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 2.511344 Jan 24 16:50:28.792322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 11/20] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:50:26 2022] POST /compute/v2.1/servers => generated 382 bytes in 2526 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:50:28.817392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4606980b-94bb-4a3e-a01c-226dbda6d628 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba16319310>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:28.870889 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4606980b-94bb-4a3e-a01c-226dbda6d628 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 200 len: 286 microversion: 2.1 time: 0.073783 Jan 24 16:50:28.871471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 12/21] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:28 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:28.879950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-48a10240-b6d7-45de-a98f-8ad5e086453c tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:28.880576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-48a10240-b6d7-45de-a98f-8ad5e086453c tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:28.956167 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3f44bfc7-f129-4684-914b-2983e9f9d4f1 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:28.965831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3f44bfc7-f129-4684-914b-2983e9f9d4f1 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1222 microversion: 2.1 time: 0.214990 Jan 24 16:50:28.979221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 10/22] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:28 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:29.424683 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-48a10240-b6d7-45de-a98f-8ad5e086453c tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:29.466353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-48a10240-b6d7-45de-a98f-8ad5e086453c tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1218 microversion: 2.1 time: 0.593787 Jan 24 16:50:29.476350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 13/23] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:28 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1218 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:29.881891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-debb4f38-1505-450f-87a2-ded82feb8366 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba162dff70>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:29.955783 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-debb4f38-1505-450f-87a2-ded82feb8366 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] HTTP exception thrown: Snapshot 2336ca28-c15e-44a4-9bca-07451437d9e4 could not be found. Jan 24 16:50:29.956386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-debb4f38-1505-450f-87a2-ded82feb8366 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Returning 404 to user: Snapshot 2336ca28-c15e-44a4-9bca-07451437d9e4 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:50:29.957753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-debb4f38-1505-450f-87a2-ded82feb8366 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4" status: 404 len: 111 microversion: 2.1 time: 0.079509 Jan 24 16:50:29.958389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 11/24] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 16:50:29 2022] GET /compute/v2.1/os-snapshots/2336ca28-c15e-44a4-9bca-07451437d9e4 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:50:29.968434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f3ffe4c2-589c-4648-bd9f-9217210f5a4c tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba162aab80>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:29.986654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:29.987554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:29.999544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:30.007499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:30.008375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:30.009059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:30.189178 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f3ffe4c2-589c-4648-bd9f-9217210f5a4c tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 202 len: 0 microversion: 2.1 time: 0.224837 Jan 24 16:50:30.189925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 14/25] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:50:29 2022] DELETE /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:50:30.198641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-769f70c0-eed6-4ce6-888e-fa4893f1d0aa tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba162aaa60>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:30.345790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-769f70c0-eed6-4ce6-888e-fa4893f1d0aa tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 200 len: 344 microversion: 2.1 time: 0.151577 Jan 24 16:50:30.346648 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 15/26] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:30 2022] GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:50:30.488382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:30.490280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:30.509837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:30.512093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:30.513184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:30.515041 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:30.523362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:30.548920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5a7112d2-a2db-454b-9afe-8c1abbed6cd0 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1218 microversion: 2.1 time: 0.567192 Jan 24 16:50:30.560503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 12/27] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:29 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1218 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:30.971755 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:31.008230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d6870440-bebb-428d-a49a-c108d781b293 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1222 microversion: 2.1 time: 0.523405 Jan 24 16:50:31.013784 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 16/28] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:30 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1222 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:31.360494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b7be9bed-438d-4947-8b4e-143592af57e9 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba15a981f0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:31.407280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-b7be9bed-438d-4947-8b4e-143592af57e9 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] HTTP exception thrown: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. Jan 24 16:50:31.408061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b7be9bed-438d-4947-8b4e-143592af57e9 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Returning 404 to user: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:50:31.408884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b7be9bed-438d-4947-8b4e-143592af57e9 tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 404 len: 109 microversion: 2.1 time: 0.053318 Jan 24 16:50:31.409439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 13/29] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:31 2022] GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:50:31.424141 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a271922-ce23-440e-ba56-84dc6d6e73bd tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba15253820>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:31.488097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-6a271922-ce23-440e-ba56-84dc6d6e73bd tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] HTTP exception thrown: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. Jan 24 16:50:31.488797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a271922-ce23-440e-ba56-84dc6d6e73bd tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Returning 404 to user: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:50:31.489986 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6a271922-ce23-440e-ba56-84dc6d6e73bd tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 404 len: 109 microversion: 2.1 time: 0.070205 Jan 24 16:50:31.490620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 17/30] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:50:31 2022] DELETE /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 16:50:31.511511 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-245d4850-1dfa-4ac9-bf52-fed55607875e tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Calling method '.version_select at 0x7fba15aa0790>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:31.568286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:31.568981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:31.582624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:31.585260 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:31.589087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:31.592494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:31.596579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-245d4850-1dfa-4ac9-bf52-fed55607875e tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] HTTP exception thrown: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. Jan 24 16:50:31.597387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-245d4850-1dfa-4ac9-bf52-fed55607875e tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] Returning 404 to user: Volume d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:50:31.598639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-245d4850-1dfa-4ac9-bf52-fed55607875e tempest-VolumesSnapshotsTestJSON-1474421541 tempest-VolumesSnapshotsTestJSON-1474421541-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3" status: 404 len: 109 microversion: 2.1 time: 0.101883 Jan 24 16:50:31.599890 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 14/31] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:50:31 2022] GET /compute/v2.1/os-volumes/d7396ff7-ba66-43aa-9e7f-4c8174cacbc3 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:50:31.868644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:31.878578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e2eb467c-46bb-4c22-a0ae-1687f251afa8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1280 microversion: 2.1 time: 0.312962 Jan 24 16:50:31.879374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 18/32] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:31 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1280 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:32.028805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:32.029280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:32.054828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:32.055316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:32.056161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:32.058048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:32.525051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:32.537370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3b4b1021-d979-423f-b35d-edc882e986e1 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1276 microversion: 2.1 time: 0.510622 Jan 24 16:50:32.540442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 15/33] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:32 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1276 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:32.897220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:32.898540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:32.910306 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:32.912775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:32.915908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:32.917796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:33.267962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:33.282024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-350721b4-28ff-4756-b308-da2503434e01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1280 microversion: 2.1 time: 0.389656 Jan 24 16:50:33.286290 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 19/34] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:32 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1280 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:33.554957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:33.556344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:33.570603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:33.574550 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:33.575446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:33.575901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:34.157351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-766576485", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9684751-c334-42d8-84b0-fcdb27d5b403"}], "security_groups": [{"name": "tempest-securitygroup--955034677"}], "key_name": "tempest-keypair-623290570", "user_data": "}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:35.146872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] validate_networks() for [('a9684751-c334-42d8-84b0-fcdb27d5b403', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:35.150653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:35.168465 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-04af22ee-2835-4f15-a3d4-ce4173be9539 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1276 microversion: 2.1 time: 1.614734 Jan 24 16:50:35.173613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 16/35] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:33 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1276 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:35.194314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:35.195382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:35.209404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:35.211510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:35.215491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:35.216287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:37.065344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:37.066544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:37.068203 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:37.069174 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:37.070561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:37.096719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:37.098347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:37.101170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:37.105015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:37.154157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:37.172348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:37.205826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:37.214046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:37.362615 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-248ccce8-b995-486d-9e76-0115826677fc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 3.210014 Jan 24 16:50:37.376224 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 20/36] 10.222.0.117 () {62 vars in 1192 bytes} [Mon Jan 24 16:50:34 2022] POST /compute/v2.1/servers => generated 403 bytes in 3224 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 24 16:50:37.390976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:37.391609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:37.418149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:37.418589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:37.427989 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:37.428522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:37.716931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:37.726268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-11cd2511-70e0-42cb-ace1-70f530732ba4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1276 microversion: 2.1 time: 0.348700 Jan 24 16:50:37.747075 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 21/37] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:37 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1276 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:37.781109 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:37.787564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:37.814441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:37.829966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-175e75a2-c1bc-4782-b1a3-d816faed4a10 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 2.652164 Jan 24 16:50:37.835070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 17/38] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:35 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 2659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:38.006394 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:38.023940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:38.028234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:38.035133 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f3f41214-520b-4581-aba9-f65a4b770dac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1284 microversion: 2.20 time: 0.281998 Jan 24 16:50:38.040325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 22/39] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:37 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:38.744882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:38.745586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:38.753411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:38.753864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:38.754664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:38.755117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:39.290563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: .version_select at 0x7fba15a8aa60>, body: {"keypair": {"name": "tempest-keypair-2022503484"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:39.303952 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:39.326460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a7b75f7b-2f90-4ea3-b41b-d56ca9cbb095 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1276 microversion: 2.1 time: 0.586011 Jan 24 16:50:39.328085 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 23/40] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:38 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1276 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:39.347147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:39.348534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:39.359230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:39.359995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:39.360997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:39.361656 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:39.372965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:39.412758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:39.934824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:39.945870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:40.016881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-475658f1-fc45-46bd-958a-1dd859823de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.311633 Jan 24 16:50:40.019964 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 18/41] 10.222.0.117 () {60 vars in 1162 bytes} [Mon Jan 24 16:50:38 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:40.044384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:40.047506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:40.066609 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:40.067652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:40.068941 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:40.069905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:40.567510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:40.581280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:40.583567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:40.596272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-27633d3e-dca5-4c30-87c4-20c12addbdf5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1344 microversion: 2.20 time: 0.574872 Jan 24 16:50:40.596873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 19/42] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:40 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1344 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:40.716855 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:40.725568 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9501a196-a71f-4b8b-b713-59a210023490 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 1.396006 Jan 24 16:50:40.726161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 24/43] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:39 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:40.753211 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:40.755714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:40.789316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:40.791852 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:40.795886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:40.796636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:41.145489 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1605867973", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:41.279102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] validate_networks() for [('a4d3963c-45d0-4dc2-b1e2-d0f377b57d04', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:41.995086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:42.009580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-21b859d9-5c0d-4e77-b441-9bbffc65b4f4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 1.271304 Jan 24 16:50:42.020976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 25/44] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:40 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:42.031495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:42.032489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:42.040822 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:42.041578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:42.042714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:42.043379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:42.627610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:42.635268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:42.636687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:42.637808 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5adf9763-2652-4416-8673-5753122ab9c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1342 microversion: 2.20 time: 0.614969 Jan 24 16:50:42.671136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 26/45] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:42 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1342 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:42.676454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:42.685131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:42.711213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:42.715550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:42.716524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:42.717044 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:43.883873 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:43.897094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-87be7d2c-32fd-4ff5-9062-d784150648f7 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 1.223488 Jan 24 16:50:43.918404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 27/46] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:42 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:43.926117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:43.933446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:43.950414 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:43.953172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:43.954403 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:43.955116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:44.699419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:44.709741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-122ebf62-995a-43b6-8a47-c3ab38c3efd5 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.789710 Jan 24 16:50:44.713094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 28/47] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:43 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:44.724201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:44.725504 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:44.759588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:44.760137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:44.760950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:44.766721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:45.325826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:45.342917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:45.348480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:45.350331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6051df13-e1e1-4cb3-89c8-6218637f38b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.635942 Jan 24 16:50:45.361406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 29/48] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:44 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:45.754595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-a0c88a79-d8ea-41ff-8c2a-a52317f3c1e9 req-bef54bc9-994b-412b-b4c8-a200b98e13b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffea6bfd-3cc1-438b-b7c3-29079c646252", "tag": "6ede1577-59cb-4655-a23e-cc2ffa5c3c79"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:45.757815 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:45.757815 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:50:45.780963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a0c88a79-d8ea-41ff-8c2a-a52317f3c1e9 req-bef54bc9-994b-412b-b4c8-a200b98e13b5 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:45.781460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a0c88a79-d8ea-41ff-8c2a-a52317f3c1e9 req-bef54bc9-994b-412b-b4c8-a200b98e13b5 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:45.835245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-a0c88a79-d8ea-41ff-8c2a-a52317f3c1e9 req-bef54bc9-994b-412b-b4c8-a200b98e13b5 service nova] Creating event network-changed:6ede1577-59cb-4655-a23e-cc2ffa5c3c79 for instance ffea6bfd-3cc1-438b-b7c3-29079c646252 on hv-cinder-82611 Jan 24 16:50:45.835789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a0c88a79-d8ea-41ff-8c2a-a52317f3c1e9 req-bef54bc9-994b-412b-b4c8-a200b98e13b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127826) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 16:50:45.837094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:45.837539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:45.838350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:45.838805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:45.880431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.compute.rpcapi [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 16:50:45.886729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] Releasing lock "compute-rpcapi-router" {{(pid=127826) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 16:50:45.949439 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5f325c62-b83a-41fb-b6cb-920937493833 None None] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.585659 Jan 24 16:50:45.951111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 30/49] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:45.958707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:45.961634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:45.994197 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:45.995538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:45.999015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.000059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.378740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:46.380036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:46.381881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:46.383255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:46.384596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:46.405517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.414895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.416583 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.417337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.490175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Getting quotas for project bed4ca830bf54f2493c46fb3cf3fbbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:46.499477 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Getting quotas for user f86b459cc02f4f38a2ced5f25972535f and project bed4ca830bf54f2493c46fb3cf3fbbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:46.532811 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:46.549687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:46.595081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:46.617225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f66e782b-ab0d-4223-9b12-7e6429dffe99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.663516 Jan 24 16:50:46.630227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 31/50] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:45 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:46.659724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:46.661024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:46.683625 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.684975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.689514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.691198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.732310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0dc985ee-8879-44be-8d84-6afcccde6516 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 6.124338 Jan 24 16:50:46.746549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 20/51] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:50:40 2022] POST /compute/v2.1/servers => generated 385 bytes in 6143 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:50:46.754579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:46.799217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:46.852916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.853420 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:46.868334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:46.869491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:47.240937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:47.252727 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6d49b368-d6e4-40ac-8d25-4c7b9352278d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.618364 Jan 24 16:50:47.266714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 32/52] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:46 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:47.272763 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-38bb1df1-ab79-4e05-9460-735cf08be5e3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:47.275361 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-38bb1df1-ab79-4e05-9460-735cf08be5e3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:47.636152 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-38bb1df1-ab79-4e05-9460-735cf08be5e3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:47.644229 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-38bb1df1-ab79-4e05-9460-735cf08be5e3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1226 microversion: 2.1 time: 0.383168 Jan 24 16:50:47.644874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 33/53] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:47 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1226 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:47.659051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:47.670463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:47.685567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:47.689069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:47.690383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:47.693167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:48.386017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:48.393636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e6565514-aa8d-4923-a103-2d54823e6fdf tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.742598 Jan 24 16:50:48.401510 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 34/54] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:47 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:48.568306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:48.590523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:48.595194 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:48.599515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3fab71b-15ef-4bef-b13e-b8eb8c05fe88 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 1.849753 Jan 24 16:50:48.602119 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 21/55] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:46 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:48.617055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1425715361", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:48.690347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-d768c180-f7f6-4891-9d56-4ec9cd874526 req-ca279cf3-78c0-49e8-b79f-e34b5e28508e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:48.698723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:48.698723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:50:48.714411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d768c180-f7f6-4891-9d56-4ec9cd874526 req-ca279cf3-78c0-49e8-b79f-e34b5e28508e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:48.714738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d768c180-f7f6-4891-9d56-4ec9cd874526 req-ca279cf3-78c0-49e8-b79f-e34b5e28508e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:48.737654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] validate_networks() for [('a4d3963c-45d0-4dc2-b1e2-d0f377b57d04', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:48.753106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-d768c180-f7f6-4891-9d56-4ec9cd874526 req-ca279cf3-78c0-49e8-b79f-e34b5e28508e service nova] Creating event network-changed:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:50:48.759041 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-d768c180-f7f6-4891-9d56-4ec9cd874526 req-ca279cf3-78c0-49e8-b79f-e34b5e28508e service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355483 Jan 24 16:50:48.760334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 35/56] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:48.765839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-7806be99-92eb-4c1c-815a-fbd9d4cd0284 req-eed6de26-7d2b-40dd-b250-81e885acc9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e", "tag": "e866c64f-ea45-4c9b-93d6-5414a8e89883"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:48.767851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:48.767851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:50:48.777695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-7806be99-92eb-4c1c-815a-fbd9d4cd0284 req-eed6de26-7d2b-40dd-b250-81e885acc9e4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:48.778672 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-7806be99-92eb-4c1c-815a-fbd9d4cd0284 req-eed6de26-7d2b-40dd-b250-81e885acc9e4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:48.811277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-7806be99-92eb-4c1c-815a-fbd9d4cd0284 req-eed6de26-7d2b-40dd-b250-81e885acc9e4 service nova] Creating event network-changed:e866c64f-ea45-4c9b-93d6-5414a8e89883 for instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e on hv-cinder-82611 Jan 24 16:50:48.825234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-7806be99-92eb-4c1c-815a-fbd9d4cd0284 req-eed6de26-7d2b-40dd-b250-81e885acc9e4 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062610 Jan 24 16:50:48.828100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 36/57] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:48.838137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:48.843962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:48.859937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:48.860556 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:48.861485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:48.862619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:49.583719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:49.595590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c558f805-f091-4463-a2b6-35da27a05b40 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.766140 Jan 24 16:50:49.599705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 37/58] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:48 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:49.611152 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:49.612803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:49.631282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:49.635644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:49.638186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:49.639417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:49.972272 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:49.995426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-881db752-d408-4dfe-b5aa-f7767bb7a498 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.387728 Jan 24 16:50:49.999430 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 38/59] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:49 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:50.017838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:50.018479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:50.035000 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:50.037546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:50.040691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:50.042567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:50.394616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:50.407592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:50.412468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:50.420865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4ef8c789-fc36-4a63-8b00-a668d9ea8cdd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.415442 Jan 24 16:50:50.437439 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 39/60] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:49 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:50.622648 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:50.623833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:50.631017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:50.631953 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:50.633087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:50.635132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.022718 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:51.033231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-13d4da4a-bcfc-4a45-a7cc-bdd576b6d19b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.416100 Jan 24 16:50:51.035197 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 40/61] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:50 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:51.056024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:51.056719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:51.075977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.075977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.075977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.075977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.305757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:51.307163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:51.307831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:51.308635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:51.309432 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:51.326033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.326498 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.329909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.330382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.341697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:51.350268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-36585869-34e3-4184-ad10-7f8de2d317b9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.298058 Jan 24 16:50:51.354151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Getting quotas for project bed4ca830bf54f2493c46fb3cf3fbbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:51.355009 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 41/62] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:51 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:51.363152 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Getting quotas for user f86b459cc02f4f38a2ced5f25972535f and project bed4ca830bf54f2493c46fb3cf3fbbc6. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:51.378552 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:51.381071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:51.450692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:51.452955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:51.468072 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b0220d2e-b1e6-44f5-836e-0e4f8dbf1f3f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.862822 Jan 24 16:50:51.473764 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 22/63] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:50:48 2022] POST /compute/v2.1/servers => generated 385 bytes in 2871 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:50:51.476374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.479024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.479243 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ea6e7753-3bdb-4521-aff7-3616c0a8e37f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:51.480073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ea6e7753-3bdb-4521-aff7-3616c0a8e37f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:51.482702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:51.483325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:51.594203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ea6e7753-3bdb-4521-aff7-3616c0a8e37f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:51.611327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ea6e7753-3bdb-4521-aff7-3616c0a8e37f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1226 microversion: 2.1 time: 0.131588 Jan 24 16:50:51.612263 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 23/64] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:51 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1226 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:52.058472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:52.060947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:52.083446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.084472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.085306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.090092 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.112616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:52.125498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:52.130132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:52.134592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1839dcc1-a697-40d3-a54b-119c3a11cced tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.690250 Jan 24 16:50:52.135352 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 42/65] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:51 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:52.372272 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:52.373899 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:52.383813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.384501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.385645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.386279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.659473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:52.705010 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3b2e516a-5ec9-4385-b2d6-e5104d3ade4b tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.650820 Jan 24 16:50:52.706656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 24/66] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:52 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:52.731961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:52.733835 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:52.753085 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.756400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.757438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:52.759903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:52.909140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:52.917765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-aef4b712-b2a7-488d-80e8-e285e35246e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1286 microversion: 2.1 time: 0.204975 Jan 24 16:50:52.921285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 25/67] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:52 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:52.929301 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1863669768", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be75c4f-241a-4241-8df3-f6088625575c"}], "security_groups": [{"name": "tempest-securitygroup--453367128"}], "key_name": "tempest-keypair-2022503484", "user_data": "}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:53.144071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] validate_networks() for [('2be75c4f-241a-4241-8df3-f6088625575c', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:50:53.223034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:53.235353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ecf27dba-d426-47cb-847a-c69d83da88dc tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.867452 Jan 24 16:50:53.237280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 43/68] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:52 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:53.248391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:53.251695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:53.270284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.275966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:53.279760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.280377 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:53.643672 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:53.652894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:53.654387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:53.655535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6081122a-d7ea-47d8-88f4-52d254dbfc46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.417340 Jan 24 16:50:53.656399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 44/69] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:53 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:53.727516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:53.728105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:53.744432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.744432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:53.745182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.745620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:53.949032 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:53.959324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-339e0492-de72-4530-a9b3-9c4aa6753e96 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.235362 Jan 24 16:50:53.973522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 45/70] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:53 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:53.979990 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:53.980606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:53.987392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.988115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:53.989338 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:53.990009 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.091088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:54.102790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f41c88ee-5024-425a-9abc-fb9b08e31733 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1284 microversion: 2.1 time: 0.126931 Jan 24 16:50:54.104405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 46/71] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:53 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:54.111026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-17fad0c5-7497-4d8e-85af-f9321f462664 req-61cfaaa8-e356-49f7-8fb3-d6e0ffee6c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5", "tag": "89e6e811-c42c-4807-b037-54df679556fd"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:54.113967 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:54.113967 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:50:54.123470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-17fad0c5-7497-4d8e-85af-f9321f462664 req-61cfaaa8-e356-49f7-8fb3-d6e0ffee6c3a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:54.124340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-17fad0c5-7497-4d8e-85af-f9321f462664 req-61cfaaa8-e356-49f7-8fb3-d6e0ffee6c3a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.138388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-17fad0c5-7497-4d8e-85af-f9321f462664 req-61cfaaa8-e356-49f7-8fb3-d6e0ffee6c3a service nova] Creating event network-changed:89e6e811-c42c-4807-b037-54df679556fd for instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 on hv-cinder-82611 Jan 24 16:50:54.144560 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-17fad0c5-7497-4d8e-85af-f9321f462664 req-61cfaaa8-e356-49f7-8fb3-d6e0ffee6c3a service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038488 Jan 24 16:50:54.145761 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 47/72] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:54.256610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:54.259068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:54.273261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:54.275257 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.276681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:54.277494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.539899 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:54.547581 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bb1610d8-d43c-4937-9e59-303e449f4b44 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.296709 Jan 24 16:50:54.548164 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 48/73] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:54 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:54.677045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:54.677666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:54.686149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:54.690318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.691630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:54.692513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:54.943319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:54.955097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:54.957827 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:54.959598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ca1fb792-a5b9-403a-8a4b-33c61f16875f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.286751 Jan 24 16:50:54.962649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 49/74] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:54 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:55.128655 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-9158a537-640c-431a-8d98-f37544e5b458 req-53ecd529-53de-47d0-9018-83da5ce5d4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e", "name": "network-vif-plugged", "status": "completed", "tag": "e866c64f-ea45-4c9b-93d6-5414a8e89883"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:55.131106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:55.131106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:50:55.142692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9158a537-640c-431a-8d98-f37544e5b458 req-53ecd529-53de-47d0-9018-83da5ce5d4a7 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.143752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9158a537-640c-431a-8d98-f37544e5b458 req-53ecd529-53de-47d0-9018-83da5ce5d4a7 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.164843 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-9158a537-640c-431a-8d98-f37544e5b458 req-53ecd529-53de-47d0-9018-83da5ce5d4a7 service nova] Creating event network-vif-plugged:e866c64f-ea45-4c9b-93d6-5414a8e89883 for instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e on hv-cinder-82611 Jan 24 16:50:55.171370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-9158a537-640c-431a-8d98-f37544e5b458 req-53ecd529-53de-47d0-9018-83da5ce5d4a7 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205745 Jan 24 16:50:55.175381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 50/75] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:55.204848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:55.207158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:55.220410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.221428 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.223069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.237349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.362613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:50:55.363286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:50:55.364273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:50:55.365331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:50:55.365852 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:50:55.380630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.384652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.387331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.388614 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.439838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:50:55.452892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:50:55.488916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:50:55.491870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:50:55.563079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:55.575836 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5a89877a-3892-44b3-8c38-85a8e9dc65ae tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.649956 Jan 24 16:50:55.577535 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 26/76] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:50:52 2022] POST /compute/v2.1/servers => generated 403 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:50:55.583199 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:55.585189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:55.586544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2d508c6a-86c2-431b-bf4c-ed88d5771a1d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.406614 Jan 24 16:50:55.594882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.597234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 51/77] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:55 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:55.610309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:55.614463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:55.616083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.624822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.626978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.632031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.633363 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:55.635673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:55.638325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:56.236716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.245841 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7f2a3025-8ccd-4c3a-ae31-cbae424d5d1e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.647354 Jan 24 16:50:56.247493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 52/78] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:55 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:56.247833 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.252087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a2a1cd0b-65af-4532-9fb3-2135b1ea9546 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:56.252854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a2a1cd0b-65af-4532-9fb3-2135b1ea9546 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:56.255245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-aabc2de6-7e42-4bdb-ac0e-9d4fd25e2d63 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.675832 Jan 24 16:50:56.256816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 27/79] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:55 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:56.272036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:56.272801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:56.287953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:56.288645 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:56.292109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:56.294890 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:56.329490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a2a1cd0b-65af-4532-9fb3-2135b1ea9546 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.337787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a2a1cd0b-65af-4532-9fb3-2135b1ea9546 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1242 microversion: 2.1 time: 0.088886 Jan 24 16:50:56.339089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 53/80] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:56 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:56.613681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:56.614398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:56.623902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:56.625920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:56.626170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:56.628229 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:56.751898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.767753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.771862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.774223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c00722e7-f05d-4dd6-b453-476930723623 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.511205 Jan 24 16:50:56.776014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 28/81] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:56 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:56.878248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:56.887650 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-231d7b22-f542-4149-a872-3d4db48bc187 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.278130 Jan 24 16:50:56.894665 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 54/82] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:56 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:57.194984 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffea6bfd-3cc1-438b-b7c3-29079c646252", "name": "network-vif-plugged", "status": "completed", "tag": "6ede1577-59cb-4655-a23e-cc2ffa5c3c79"}, {"server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "name": "network-vif-plugged", "status": "completed", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:57.199579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:57.199579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:50:57.221248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.221697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.263754 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:57.264360 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:57.277461 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.277905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.283696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Creating event network-vif-plugged:6ede1577-59cb-4655-a23e-cc2ffa5c3c79 for instance ffea6bfd-3cc1-438b-b7c3-29079c646252 on hv-cinder-82611 Jan 24 16:50:57.284379 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Creating event network-vif-plugged:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:50:57.284895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-fa0147f6-2b50-41c4-95f4-95dfb8069bf6 req-a52229d1-1149-4eb8-a13d-3f02e9307806 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 24 16:50:57.286160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.286606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.287484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.291874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.292330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.292805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.317729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.compute.rpcapi [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 24 16:50:57.319146 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] Releasing lock "compute-rpcapi-router" {{(pid=127827) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 24 16:50:57.365331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-95386a37-0422-4cc5-adc5-0cba26271376 None None] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.176095 Jan 24 16:50:57.366285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 29/83] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:57.374781 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:57.376798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:57.399049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.400041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.402354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.403114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.757093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:57.780778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-28b0caee-9d87-46f2-8afc-db8f12fad40f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.516750 Jan 24 16:50:57.792810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 55/84] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:57 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:57.799242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:57.801041 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:57.810795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.811465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.812448 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.813470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.830858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:57.842224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b8f9ca29-cad3-4593-b1cf-7924d3b2d62d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.474365 Jan 24 16:50:57.842916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 30/85] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:57 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:57.870556 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-b696635d-1ada-4dc3-a016-e6a2aa4cd0e7 req-d7ad93f5-e22f-4c55-ace4-29069e18716c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f33a394e-abd2-4047-a8a5-75c89566dbd2", "tag": "5b46c1cc-6728-4897-8738-0827955179b2"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:50:57.892857 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:50:57.892857 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:50:57.902713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-b696635d-1ada-4dc3-a016-e6a2aa4cd0e7 req-d7ad93f5-e22f-4c55-ace4-29069e18716c service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.912224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-b696635d-1ada-4dc3-a016-e6a2aa4cd0e7 req-d7ad93f5-e22f-4c55-ace4-29069e18716c service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.926230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-b696635d-1ada-4dc3-a016-e6a2aa4cd0e7 req-d7ad93f5-e22f-4c55-ace4-29069e18716c service nova] Creating event network-changed:5b46c1cc-6728-4897-8738-0827955179b2 for instance f33a394e-abd2-4047-a8a5-75c89566dbd2 on hv-cinder-82611 Jan 24 16:50:57.939026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-b696635d-1ada-4dc3-a016-e6a2aa4cd0e7 req-d7ad93f5-e22f-4c55-ace4-29069e18716c service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087891 Jan 24 16:50:57.939934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 31/86] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:50:57.945544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:57.947049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:57.954189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.954984 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:57.955990 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:57.956648 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.019060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:58.058019 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e60a0010-eae1-4efd-9b56-5ba1366adc56 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1300 microversion: 2.1 time: 0.261217 Jan 24 16:50:58.058868 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 56/87] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:57 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:58.082071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:58.082723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:58.096486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.096956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.097768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.098216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.514704 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:58.535719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:58.540097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:58.542275 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-107cc0ce-0196-4261-ba5b-695a86b58075 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.600733 Jan 24 16:50:58.553667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 32/88] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:57 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:50:58.677395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:58.690873 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c24c77e8-9fe4-4b66-9b36-93667c799d47 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1318 microversion: 2.1 time: 0.625170 Jan 24 16:50:58.691927 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 57/89] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:58 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:58.799685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:58.800730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:58.811884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.812726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.814718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.816917 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.862099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:58.863036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:58.872758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.873401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:58.874456 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:58.875096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.027084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:59.039413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2120d430-f180-4a90-a470-ec38968938b4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1322 microversion: 2.1 time: 0.243148 Jan 24 16:50:59.040362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 33/90] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:58 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:50:59.077682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:59.078726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:59.086891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.087809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.090001 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.090672 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.154349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:59.161983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5256892d-d0db-476f-a2ee-80a18c0bb1f0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.305483 Jan 24 16:50:59.170058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 58/91] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:58 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:59.301911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:50:59.318384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a1b37816-8d32-4a4d-812a-d968a54e9c93 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.245211 Jan 24 16:50:59.319766 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 34/92] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:59 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:50:59.561633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:59.562745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:59.571420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.572296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.573734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.575513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.710519 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:50:59.712457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:50:59.721461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.722543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.723611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:50:59.724295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:50:59.991642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.001046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.012177 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.013368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.015079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-32e4fbae-6ce1-4c69-9d46-9ae9490541d5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1409 microversion: 2.20 time: 0.457786 Jan 24 16:51:00.016036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 59/93] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:50:59 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1409 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:51:00.041340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b160e3df-94df-4732-b877-9cbada4ad4d2 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1505 microversion: 2.1 time: 0.336362 Jan 24 16:51:00.042592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 35/94] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:50:59 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:00.059084 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:00.060380 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:00.069161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.072923 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.076521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.077019 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.189130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:00.189717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:00.211969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.212982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.216034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.219562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.440609 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.451565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e1d98892-738a-4730-a531-18be7846e4ad tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.268978 Jan 24 16:51:00.454576 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 36/95] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:00 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:00.480366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:00.481116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:00.495620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.498455 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.499537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:00.500188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:00.767912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.779165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-df8c4b10-0e10-45ba-8293-1150e9360eea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1512 microversion: 2.1 time: 0.726874 Jan 24 16:51:00.779928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 60/96] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:00 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1512 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:00.835518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:00.847040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b8760502-323f-42da-ad3e-79a5db3288cf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.391071 Jan 24 16:51:00.847632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 37/97] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:00 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:01.033698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:01.034865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:01.047574 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-628ead8c-defd-43ff-bc29-4f5709b71e99 req-cb204fc3-10ce-4a5b-a314-b5a74d9fad2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c5d45c-1da7-4563-ac75-ae5d1dc892ec", "tag": "0ca8e31f-a171-49fb-ae74-f6d668a389a9"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:01.050095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:01.050095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:51:01.052633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.053313 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.054915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.058407 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.069244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-628ead8c-defd-43ff-bc29-4f5709b71e99 req-cb204fc3-10ce-4a5b-a314-b5a74d9fad2a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.071788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-628ead8c-defd-43ff-bc29-4f5709b71e99 req-cb204fc3-10ce-4a5b-a314-b5a74d9fad2a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.104518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-628ead8c-defd-43ff-bc29-4f5709b71e99 req-cb204fc3-10ce-4a5b-a314-b5a74d9fad2a service nova] Creating event network-changed:0ca8e31f-a171-49fb-ae74-f6d668a389a9 for instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec on hv-cinder-82611 Jan 24 16:51:01.119155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-628ead8c-defd-43ff-bc29-4f5709b71e99 req-cb204fc3-10ce-4a5b-a314-b5a74d9fad2a service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076692 Jan 24 16:51:01.125355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 38/98] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:51:01.447026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:01.457933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:01.461824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:01.464292 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-076178d8-a941-4788-bc14-3c26935fc009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1601 microversion: 2.20 time: 0.434598 Jan 24 16:51:01.465947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 61/99] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:51:01 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1601 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:51:01.472523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:01.473465 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:01.489788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.490259 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.492516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:01.493235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.493781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:01.494374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.510796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.512793 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.513653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.514098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.698435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:01.706715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cd6ec2f7-d494-4fa8-880a-cbcc491b5f10 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.237885 Jan 24 16:51:01.707662 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 39/100] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:01 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:01.712982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a2194d6-3e0f-400f-ba6e-82a2dd673b2a"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:01.714234 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:01.720835 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.721289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.722071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.722513 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.833284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-aeaf89d3-2524-4ff1-999a-c744ddc88a5a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.347709 Jan 24 16:51:01.833882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 62/101] 10.222.0.117 () {60 vars in 1320 bytes} [Mon Jan 24 16:51:01 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-interface => generated 285 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:01.864688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:01.865504 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:01.874424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.876176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:01.877722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:01.878917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:02.226970 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d41c6138-ca69-4f29-af38-9f01d09f6f90 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "POST /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517561 Jan 24 16:51:02.228138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 40/102] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:51:01 2022] POST /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:02.250118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-d4b5c74b-c124-4553-a49c-daad1c2e8211 req-524bd23c-ca17-4630-abeb-8b4593bcef4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5", "name": "network-vif-plugged", "status": "completed", "tag": "89e6e811-c42c-4807-b037-54df679556fd"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:02.257872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:02.257872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:51:02.270175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d4b5c74b-c124-4553-a49c-daad1c2e8211 req-524bd23c-ca17-4630-abeb-8b4593bcef4a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:02.270967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d4b5c74b-c124-4553-a49c-daad1c2e8211 req-524bd23c-ca17-4630-abeb-8b4593bcef4a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:02.288093 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-d4b5c74b-c124-4553-a49c-daad1c2e8211 req-524bd23c-ca17-4630-abeb-8b4593bcef4a service nova] Creating event network-vif-plugged:89e6e811-c42c-4807-b037-54df679556fd for instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 on hv-cinder-82611 Jan 24 16:51:02.295025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:02.295957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-d4b5c74b-c124-4553-a49c-daad1c2e8211 req-524bd23c-ca17-4630-abeb-8b4593bcef4a service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064890 Jan 24 16:51:02.297015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 41/103] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:02.306040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-73a0dc9f-b70d-4acc-838c-7b2ea5a77b70 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.445000 Jan 24 16:51:02.307547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 63/104] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:01 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:02.472365 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f500d057-0f78-43f7-84ac-206880924368"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:02.473832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:02.481671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:02.482525 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:02.483517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:02.484124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:02.723778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:02.736200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:02.755129 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:02.755575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:02.756380 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:02.760419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:03.142300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:03.160397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f6f110c9-2fc9-4fd6-9585-7cfb66a2bd09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.440265 Jan 24 16:51:03.161292 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 64/105] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:02 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:03.212298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3297c79-e2e5-45f5-81d8-98f0d374ce6c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746049 Jan 24 16:51:03.218221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 42/106] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:51:02 2022] POST /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:03.324719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:03.326030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:03.372229 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:03.373126 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:03.378513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:03.380982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:03.726120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:03.741851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-671c8728-2a23-4a94-afb7-b518133782ab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.421589 Jan 24 16:51:03.774344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 65/107] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:03 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:04.183581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:04.183581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:04.189123 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:04.190233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:04.197048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.197731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.198436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.201762 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.201977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.201977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.201977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.201977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.337859 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5ac0764e-441c-40f2-af43-afd338ed8b7f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.151941 Jan 24 16:51:04.340174 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 66/108] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:04 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:04.346808 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-39a3873c-9ef6-4fe7-ae13-9efef9f5de2a req-26d61a51-cc02-4374-9282-02e03c13b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:04.353065 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:04.353065 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:04.389506 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-39a3873c-9ef6-4fe7-ae13-9efef9f5de2a req-26d61a51-cc02-4374-9282-02e03c13b5c3 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.389950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-39a3873c-9ef6-4fe7-ae13-9efef9f5de2a req-26d61a51-cc02-4374-9282-02e03c13b5c3 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.418643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-39a3873c-9ef6-4fe7-ae13-9efef9f5de2a req-26d61a51-cc02-4374-9282-02e03c13b5c3 service nova] Creating event network-changed:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:51:04.427228 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-39a3873c-9ef6-4fe7-ae13-9efef9f5de2a req-26d61a51-cc02-4374-9282-02e03c13b5c3 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081588 Jan 24 16:51:04.428256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 67/109] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:04.444476 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-b910e495-2d80-4ec6-9bd7-bd7bf084a707 req-7fa2701e-05fe-4728-a468-c953cae42d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33a394e-abd2-4047-a8a5-75c89566dbd2", "name": "network-vif-plugged", "status": "completed", "tag": "5b46c1cc-6728-4897-8738-0827955179b2"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:04.447752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:04.447752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:04.477835 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-b910e495-2d80-4ec6-9bd7-bd7bf084a707 req-7fa2701e-05fe-4728-a468-c953cae42d53 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.480259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-b910e495-2d80-4ec6-9bd7-bd7bf084a707 req-7fa2701e-05fe-4728-a468-c953cae42d53 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.509193 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-b910e495-2d80-4ec6-9bd7-bd7bf084a707 req-7fa2701e-05fe-4728-a468-c953cae42d53 service nova] Creating event network-vif-plugged:5b46c1cc-6728-4897-8738-0827955179b2 for instance f33a394e-abd2-4047-a8a5-75c89566dbd2 on hv-cinder-82611 Jan 24 16:51:04.518820 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-b910e495-2d80-4ec6-9bd7-bd7bf084a707 req-7fa2701e-05fe-4728-a468-c953cae42d53 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085967 Jan 24 16:51:04.522517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:04.528782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 68/110] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:04.532176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-17deae6c-09ff-4e14-9161-9ebcaec95424 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.355493 Jan 24 16:51:04.539946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 43/111] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:04 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:04.794594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:04.795535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:04.815654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.816376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:04.817284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:04.817717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:05.360852 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:05.361864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:05.365144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:05.373605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3b6154f7-3534-4e7b-be61-cb1b7cd495f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.583326 Jan 24 16:51:05.373830 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:05.374293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:05.375127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:05.378240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 69/112] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:04 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:05.383737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:05.561053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:05.563490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:05.596936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:05.597470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:05.598311 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:05.598768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:05.658995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f8f11cd3-fc1c-4f94-a242-364b1a4a22d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.312521 Jan 24 16:51:05.659889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 44/113] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:05 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:05.943574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:05.964226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9ffe8344-565f-4e0b-a668-55bd6cd338e4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.410439 Jan 24 16:51:05.969611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 70/114] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:05 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:06.396334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:06.397279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:06.405558 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.406139 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:06.406975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.407418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:06.584247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:06.592750 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f9a72a8a-87a8-4ed4-8074-1ffa5be94b55 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.201123 Jan 24 16:51:06.593578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 45/115] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:06 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:06.672255 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:06.673847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:06.682026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.682578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:06.683620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.684119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:06.784924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a710a8b4-2982-435c-ba3c-9331a4aa3f4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.116924 Jan 24 16:51:06.786030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 71/116] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:06 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:06.985489 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:06.985942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:06.993606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.994154 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:06.995175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:06.995858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:07.224521 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:07.234694 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c9e016e1-8b8e-4266-8597-587e7c88921d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1326 microversion: 2.1 time: 0.253074 Jan 24 16:51:07.248114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 46/117] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:06 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1326 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:07.611374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:07.612260 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:07.620411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:07.627415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:07.627415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:07.627415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:07.766652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:07.774717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c7cc7be7-6123-48f4-86d3-a86549fe5015 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.168153 Jan 24 16:51:07.775554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 72/118] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:07 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:07.795627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:07.796757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:07.803084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:07.803630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:07.804748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:07.805269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:07.901219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fd0a5d45-3075-490c-ab6f-50c6a434aa0d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.109112 Jan 24 16:51:07.901840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 47/119] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:07 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:08.081700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-1d7326d4-3194-40dd-b4c6-cafe1564c2e5 req-e14a985c-ca01-4aa0-8681-ad9a3c052e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c5d45c-1da7-4563-ac75-ae5d1dc892ec", "name": "network-vif-plugged", "status": "completed", "tag": "0ca8e31f-a171-49fb-ae74-f6d668a389a9"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:08.083302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:08.083302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:08.096627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1d7326d4-3194-40dd-b4c6-cafe1564c2e5 req-e14a985c-ca01-4aa0-8681-ad9a3c052e67 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.097078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1d7326d4-3194-40dd-b4c6-cafe1564c2e5 req-e14a985c-ca01-4aa0-8681-ad9a3c052e67 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.110115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-1d7326d4-3194-40dd-b4c6-cafe1564c2e5 req-e14a985c-ca01-4aa0-8681-ad9a3c052e67 service nova] Creating event network-vif-plugged:0ca8e31f-a171-49fb-ae74-f6d668a389a9 for instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec on hv-cinder-82611 Jan 24 16:51:08.114942 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-1d7326d4-3194-40dd-b4c6-cafe1564c2e5 req-e14a985c-ca01-4aa0-8681-ad9a3c052e67 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041671 Jan 24 16:51:08.115735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 73/120] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:08.262428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:08.263163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:08.270121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.270579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.271406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.271850 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.506612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:08.519805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0e2d78fa-8f5b-4d77-b47c-188461478832 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1520 microversion: 2.1 time: 0.261350 Jan 24 16:51:08.520744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 48/121] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:08 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:08.538200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:08.539588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:08.550183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.550642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.552171 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.552612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.591200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lazy-loading 'flavor' on Instance uuid f33a394e-abd2-4047-a8a5-75c89566dbd2 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:51:08.759651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-57d3d2ef-0379-49d9-9349-a2f7904fcb59 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2/action" status: 200 len: 32 microversion: 2.1 time: 0.224209 Jan 24 16:51:08.761570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 74/122] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:08 2022] POST /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:08.777024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:08.778537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:08.793695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.794292 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.795435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:08.796166 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:08.802539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:08.803460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:09.016353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:09.016807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:09.017597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:09.018028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:09.043282 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:09.053136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d20b825c-6b75-4d3d-b3d7-68c76991e50f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.286314 Jan 24 16:51:09.054627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 49/123] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:08 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:09.060909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:09.062005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:09.068251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:09.068703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:09.069608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:09.070074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:09.194309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ee9fdb32-9f95-401a-b2a2-e05c7bead2b4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.138079 Jan 24 16:51:09.194979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 50/124] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:09 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:09.334477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:09.345061 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-916c9452-7803-4f82-b4dd-cec0365e9e42 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.552029 Jan 24 16:51:09.345848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 75/125] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:08 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:10.071986 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:10.072939 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:10.080340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.080801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.081593 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.082034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.205601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:10.207477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:10.216806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.217698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.219079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.219759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.230124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:10.241826 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-16abc32b-67b6-4fc7-8c41-c49e0601d555 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.172827 Jan 24 16:51:10.242581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 51/126] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:10 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:10.362236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:10.362873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:10.370135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.370799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.371591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:10.372028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:10.437457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-91f412f9-4a40-4c98-b716-4aa4d0f44b46 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.235891 Jan 24 16:51:10.439076 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 76/127] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:10 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:10.545117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:10.556162 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-82346bcf-b32d-420b-b463-af052535ac99 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1367 microversion: 2.1 time: 0.197456 Jan 24 16:51:10.557200 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 52/128] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:10 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:10.938819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-844704046", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "a212a263-addf-4bd8-b46c-96697d6542c3"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:10.990124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] validate_networks() for [('a212a263-addf-4bd8-b46c-96697d6542c3', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:51:11.259883 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:11.260557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:11.271208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.271656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.272442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.273173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.353756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:51:11.354336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:51:11.354769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:51:11.355204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:51:11.355613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:51:11.365616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.367258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.368096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.368536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.386950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Getting quotas for project e5e86d82e0524fd380e44df98739cfa3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:51:11.390874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Getting quotas for user 54f058a8f1014fde9d4ec742e8174d00 and project e5e86d82e0524fd380e44df98739cfa3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:51:11.402045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:51:11.404488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:51:11.405358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:11.412699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ade93e7c-fd87-4eb4-a439-2b34a5bfb480 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.156996 Jan 24 16:51:11.414129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 53/129] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:11 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:11.448237 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:11.449148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:11.452231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-053fb9c8-a312-4338-a197-b21ae56e8bf7 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.517369 Jan 24 16:51:11.457570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 77/130] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:51:10 2022] POST /compute/v2.1/servers => generated 382 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:51:11.457716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.457716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.457716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.457716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.464999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3b1c331f-5708-4b9e-8b8d-d0a7f1b0aa1b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:11.465604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3b1c331f-5708-4b9e-8b8d-d0a7f1b0aa1b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:11.523972 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3b1c331f-5708-4b9e-8b8d-d0a7f1b0aa1b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:11.533758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3b1c331f-5708-4b9e-8b8d-d0a7f1b0aa1b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1217 microversion: 2.1 time: 0.073560 Jan 24 16:51:11.534651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 78/131] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:11 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:11.546167 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5dd7dc4f-3053-4a71-886a-0e45c92503c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.101590 Jan 24 16:51:11.546820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 54/132] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:11 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:11.575964 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:11.576590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:11.586817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.587281 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.588087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.588531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.757292 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:11.771703 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b1327aec-3158-4b5e-b9a3-d3faa54a66da tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1554 microversion: 2.1 time: 0.195709 Jan 24 16:51:11.773321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 79/133] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:11 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1554 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:11.790481 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:11.791107 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:11.820250 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.824116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.826871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:11.827504 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:11.931012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f9726a72-4f5d-4abb-9b1c-211c8ce1e2bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144596 Jan 24 16:51:11.931604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 55/134] 10.222.0.117 () {58 vars in 1279 bytes} [Mon Jan 24 16:51:11 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:12.161031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:12.161536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:12.170441 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.171347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.172908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.173561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.206186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:51:12.305053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-657c521c-18e7-424e-887a-3f3255aaa868 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 204 len: 0 microversion: 2.1 time: 0.150717 Jan 24 16:51:12.305847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 80/135] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:51:12 2022] DELETE /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:51:12.314291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:12.314953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:12.322366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.323088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.323889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.324331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.430247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:12.430979 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:12.437896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.438435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.439689 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.440343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.564710 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:12.573251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-76bf33aa-d637-4853-b9f7-e55d6fdb5337 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1557 microversion: 2.1 time: 0.262957 Jan 24 16:51:12.573840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 56/136] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:12 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1557 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:12.587997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:12.588973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:12.594869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.595328 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.596122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.596560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.636571 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:12.644551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-541ead69-2b9a-435a-8c0b-17cb5e643c8f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.218823 Jan 24 16:51:12.650742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 81/137] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:12 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:12.655380 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:12.656098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:12.662206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.662641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.664244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:12.664673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:12.692389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8947c840-fda5-41c2-94e1-4cbff3918a22 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.107890 Jan 24 16:51:12.693046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 57/138] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:12 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:12.755725 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:12.768871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-45629ede-75c5-4737-bd87-376b5f673456 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1269 microversion: 2.1 time: 0.122667 Jan 24 16:51:12.769563 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 82/139] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:12 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1269 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:13.401434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:13.403393 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:13.408911 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-a6e984a9-df7f-432b-9c0e-d9329890b338 req-142d3c59-6e9c-4a36-ba3b-48b7c0f5408a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c5d45c-1da7-4563-ac75-ae5d1dc892ec", "tag": "0ca8e31f-a171-49fb-ae74-f6d668a389a9"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:13.410552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:13.410552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:13.411308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.411820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.414582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.415170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.421817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a6e984a9-df7f-432b-9c0e-d9329890b338 req-142d3c59-6e9c-4a36-ba3b-48b7c0f5408a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.422554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a6e984a9-df7f-432b-9c0e-d9329890b338 req-142d3c59-6e9c-4a36-ba3b-48b7c0f5408a service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.438861 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-a6e984a9-df7f-432b-9c0e-d9329890b338 req-142d3c59-6e9c-4a36-ba3b-48b7c0f5408a service nova] Creating event network-changed:0ca8e31f-a171-49fb-ae74-f6d668a389a9 for instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec on hv-cinder-82611 Jan 24 16:51:13.447063 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-a6e984a9-df7f-432b-9c0e-d9329890b338 req-142d3c59-6e9c-4a36-ba3b-48b7c0f5408a service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Jan 24 16:51:13.447667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 83/140] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:13.521330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dcfda2e4-8840-43c9-aca6-737259472067 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.124289 Jan 24 16:51:13.522341 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 58/141] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:13 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:13.591557 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:13.592676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:13.599712 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.601757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.602785 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.603411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.663008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:13.663857 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:13.670687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.671159 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.671973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.672403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.812947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:13.834233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-bb6f54bd-8283-49b4-ada7-af6dd656598b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.175796 Jan 24 16:51:13.839891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 59/142] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:13 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:13.845538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:13.847090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:13.854222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.855003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.856104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.856640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.918555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-71bd7b16-e52c-4960-87a2-3983387433ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.076958 Jan 24 16:51:13.921820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 60/143] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:13 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:13.924999 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:13.926164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:13.936936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.938532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:13.939715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:13.940344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.030080 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:14.042098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ffa63463-e117-4103-8675-e4b70b9f359e tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1275 microversion: 2.1 time: 0.121227 Jan 24 16:51:14.042875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 61/144] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:13 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:14.273778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:14.284977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-482d84b9-b132-4411-84ac-ca465c2aa126 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1557 microversion: 2.1 time: 0.697180 Jan 24 16:51:14.285832 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 84/145] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:13 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1557 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:14.535149 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:14.536974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:14.548770 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.551729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.554046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.555699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.684022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b54426e5-3e78-49c8-9a9b-c5a862246916 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.149523 Jan 24 16:51:14.692428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 62/146] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:14 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:51:14.853708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:14.854328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:14.861427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.861920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.863303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.864081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.931256 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:14.932552 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:14.939153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.939602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:14.940669 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:14.941098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.018697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-987e6c61-71ea-48be-a6ef-811709bccb42 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.092714 Jan 24 16:51:15.022742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 63/147] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:14 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:15.061713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:15.062444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:15.071660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.072340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.073334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.073963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.227447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:15.239690 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f55f0f56-1045-41ce-980c-3e47e0e1f44a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.391205 Jan 24 16:51:15.241318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 85/148] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:14 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:15.302155 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:15.304028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:15.313555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.314052 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.315658 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.316663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.399247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:15.411470 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8a22d081-5ddc-40e9-8f0f-83a75fb09530 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.354980 Jan 24 16:51:15.412331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 64/149] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:15 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:15.702300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:15.702300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:15.706224 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:15.708023 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.708477 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.709268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:15.709917 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:15.720775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-342b633a-ed65-467f-8f5f-1929431b6434 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1557 microversion: 2.1 time: 0.421422 Jan 24 16:51:15.731387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 86/150] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:15 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1557 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:15.795404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f0b62588-e44d-4190-b21e-3bda84aa156a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.099452 Jan 24 16:51:15.796041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 65/151] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:15 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:16.031110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:16.032226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:16.041540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.042241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.043309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.044008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.099912 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-00399471-783e-481c-a3da-18fd62f83ddd req-c8a580a9-f519-45bb-9ce4-13806ec0bf3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0fd420-7ca2-4584-bc5c-6d1ed60ca543", "tag": "c7a88162-0e4c-42a3-adce-9ee7d02857c6"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:16.102088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:16.102088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:51:16.113793 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-00399471-783e-481c-a3da-18fd62f83ddd req-c8a580a9-f519-45bb-9ce4-13806ec0bf3e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.114426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-00399471-783e-481c-a3da-18fd62f83ddd req-c8a580a9-f519-45bb-9ce4-13806ec0bf3e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.125275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9b87ed2d-1a68-4925-a7eb-274d285c33a4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.098193 Jan 24 16:51:16.126633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-00399471-783e-481c-a3da-18fd62f83ddd req-c8a580a9-f519-45bb-9ce4-13806ec0bf3e service nova] Creating event network-changed:c7a88162-0e4c-42a3-adce-9ee7d02857c6 for instance ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 on hv-cinder-82611 Jan 24 16:51:16.129311 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 87/152] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:16 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:16.141963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-00399471-783e-481c-a3da-18fd62f83ddd req-c8a580a9-f519-45bb-9ce4-13806ec0bf3e service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045859 Jan 24 16:51:16.142582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 66/153] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:16.259088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:16.259798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:16.270413 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.270949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.272011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.272468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.433500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:16.434257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:16.447529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.447951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.448822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.449251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.611617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:16.619474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-edc4a50c-5b4a-4386-9427-d014f87d9669 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.194470 Jan 24 16:51:16.620656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 67/154] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:16 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:16.738608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:16.739292 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:16.748403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.749115 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.750358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.750897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.822051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:16.827195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b9a988ccba046e399cb0f755b9a03e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d59c94478d24e3f917829b148941337', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:16.834068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-435a3966-5a78-4e51-83a8-48e18977ebc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.580307 Jan 24 16:51:16.835582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 88/155] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:16 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:16.840289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:16.841440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:16.850957 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.851776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.852944 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:16.853446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d2060b8e-5569-432b-9425-a03abd1a8466 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 200 len: 1349 microversion: 2.1 time: 0.113718 Jan 24 16:51:16.853949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:16.854738 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 68/156] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:16 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 1349 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:16.936899 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f7a7740d-48e3-4939-ae12-0aa616557719 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.099865 Jan 24 16:51:16.940736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 89/157] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:16 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:17.137770 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:17.139077 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:17.145436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.145892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.146674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.147703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.239104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-893276a8-867d-4c59-8aef-b951c6bcb727 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.104977 Jan 24 16:51:17.239901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 69/158] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:17 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:17.643686 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:17.644598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:17.657262 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.658325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.659875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.660756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.839404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:17.848561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4f9bb67c-dcbb-498b-a4e4-4dbd7a9943b4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.210984 Jan 24 16:51:17.849027 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 90/159] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:17 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:17.866404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:17.867915 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:17.871723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:17.872334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:17.875009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.875469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.876263 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.876708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.879937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.880479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.884097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.884624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.902789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] HTTP exception thrown: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. Jan 24 16:51:17.903388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Returning 404 to user: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:17.904493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f3830bb4-c89f-4271-a54a-a94f269d4a3f tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 404 len: 111 microversion: 2.1 time: 0.036319 Jan 24 16:51:17.905059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 91/160] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:17 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:51:17.950996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:17.953032 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:17.961694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.962696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:17.964595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:17.965039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.060345 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4ddcb621-780f-470b-bb0e-c20ef3f51cf4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.114391 Jan 24 16:51:18.061188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 92/161] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:17 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:51:18.067117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:18.068117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:18.073231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:18.084913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-83abb3a3-2db3-4f38-844c-f79cc7300543 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.235650 Jan 24 16:51:18.085723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.095336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.095509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 70/162] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:17 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:18.095621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.095621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.102034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] HTTP exception thrown: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. Jan 24 16:51:18.102633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Returning 404 to user: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:18.103496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e6e4b45b-4db9-4b29-9877-7edfb46b874d tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041306 Jan 24 16:51:18.104052 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 93/163] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:51:18 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:51:18.175557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-8b7c4c69-5951-4773-afc8-c9f1e4075820 req-78766f66-03a5-4c21-93b5-970cc57fb62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e", "name": "network-vif-deleted", "tag": "e866c64f-ea45-4c9b-93d6-5414a8e89883"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:18.177269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:18.177269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:51:18.203612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-8b7c4c69-5951-4773-afc8-c9f1e4075820 req-78766f66-03a5-4c21-93b5-970cc57fb62d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.204071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-8b7c4c69-5951-4773-afc8-c9f1e4075820 req-78766f66-03a5-4c21-93b5-970cc57fb62d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.214956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-8b7c4c69-5951-4773-afc8-c9f1e4075820 req-78766f66-03a5-4c21-93b5-970cc57fb62d service nova] Creating event network-vif-deleted:e866c64f-ea45-4c9b-93d6-5414a8e89883 for instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e on hv-cinder-82611 Jan 24 16:51:18.228133 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-8b7c4c69-5951-4773-afc8-c9f1e4075820 req-78766f66-03a5-4c21-93b5-970cc57fb62d service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059366 Jan 24 16:51:18.228943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 71/164] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:51:18.252689 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:18.253605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:18.264618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.265068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.265869 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.266310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.397415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-256119f6-56dc-47e5-b5fa-3fb002d78765 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 14 microversion: 2.20 time: 0.151520 Jan 24 16:51:18.400598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 94/165] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:18 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:18.871529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:18.872779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:18.886441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.886928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:18.887728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:18.888372 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.034015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:19.041901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-87abfd99-c1f0-4a6d-aeb5-67dba24f0963 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.174911 Jan 24 16:51:19.042462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 72/166] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:18 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:19.071326 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:19.072343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:19.079486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.079943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.080733 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.081170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.102089 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:19.102925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:19.108979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.109512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.111321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.111676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.183050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0ac5a9b5-3c72-4603-b105-94224cbce39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.115327 Jan 24 16:51:19.183694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 95/167] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:19 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:19.265450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:19.272834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c677bedf-fa08-4fab-9c43-e4279995a35e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.175269 Jan 24 16:51:19.274056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 73/168] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:19 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:19.332800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:19.333392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:19.341197 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.341658 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.342443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.342917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.367120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] HTTP exception thrown: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. Jan 24 16:51:19.368016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Returning 404 to user: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:19.369405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-825ca281-d367-4870-b6fe-69bf778a0437 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 404 len: 111 microversion: 2.1 time: 0.040668 Jan 24 16:51:19.370194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 96/169] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:51:19 2022] DELETE /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:51:19.378440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:19.379139 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] [instance: f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:19.386904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.387560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.388544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.389398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.405213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] HTTP exception thrown: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. Jan 24 16:51:19.405887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] Returning 404 to user: Instance f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:19.407031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-17ad33b9-0c10-43c9-b6d3-b86c557adde4 tempest-DeleteServersTestJSON-1195786061 tempest-DeleteServersTestJSON-1195786061-project] 10.222.0.117 "GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e" status: 404 len: 111 microversion: 2.1 time: 0.032357 Jan 24 16:51:19.407714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 74/170] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:19 2022] GET /compute/v2.1/servers/f22d7ef3-3e0c-4c6e-ae1f-6c1ad225038e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:51:19.407904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:19.408960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:19.416661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.417095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.417872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:19.418304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:19.530726 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-51751078-7dc6-4545-b6ee-121a83196ebe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 56 microversion: 2.20 time: 0.126314 Jan 24 16:51:19.531388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 97/171] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:19 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 56 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:19.581178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2067134106", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "d2067982-5a38-46c1-8ec9-527550d6c2b1"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:19.630795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] validate_networks() for [('d2067982-5a38-46c1-8ec9-527550d6c2b1', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:51:20.058814 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:20.059480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:20.067177 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.067636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.069049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.069804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.323163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:20.331067 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-62890a83-5192-48f7-a7b0-34816500558d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.277457 Jan 24 16:51:20.331757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 98/172] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:20 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:20.354620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:51:20.355175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:51:20.355588 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:51:20.355989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:51:20.356543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:51:20.362745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:20.365150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:20.366449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.367046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.368696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.369201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.381952 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.382398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.383834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.384435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.387241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:51:20.391936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for user feb8ddf0abd84c1caed8501c57b56f20 and project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:51:20.419692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:51:20.422927 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:51:20.485975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dcce5ed0-95d4-440c-b496-085f141f4b30 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.908506 Jan 24 16:51:20.494101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 75/173] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:51:19 2022] POST /compute/v2.1/servers => generated 382 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:51:20.498777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:20.498936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-70c2b233-3e44-45a0-8817-88822109d44e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.155217 Jan 24 16:51:20.499377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:20.500343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 99/174] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:20 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:20.506561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.506999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1afa8262-202a-4e28-8a2f-2d1ab336ed19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:20.507463 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.508536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1afa8262-202a-4e28-8a2f-2d1ab336ed19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:20.509596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.510294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.598894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1afa8262-202a-4e28-8a2f-2d1ab336ed19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:20.608801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1afa8262-202a-4e28-8a2f-2d1ab336ed19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1222 microversion: 2.1 time: 0.106749 Jan 24 16:51:20.609594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 100/175] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:20 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:20.634718 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:20.635803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:20.652906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.653355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.657877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:20.658490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:20.751003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:20.760697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-667d455b-6a7d-4f86-b197-83bd560237dc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.265485 Jan 24 16:51:20.761281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 76/176] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:20 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:20.784617 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-be15bcd3-1545-4e45-8f02-071c7d6f63ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 6536 microversion: 2.20 time: 0.163053 Jan 24 16:51:20.785275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 101/177] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:20 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 6536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:51:21.358232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:21.358881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:21.365176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.365618 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.366409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.366909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.515702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:21.519038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:21.534821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.535468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.536266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.536708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.543494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:21.551646 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0274678c-42c4-46b2-8cb5-f50d56e1d056 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.197344 Jan 24 16:51:21.552222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 77/178] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:21 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:21.626009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:21.626616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:21.632930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.633559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.634609 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.635160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.704281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:21.715449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-18982e29-4639-4da2-9969-8e90f5282936 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1218 microversion: 2.1 time: 0.092900 Jan 24 16:51:21.716031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 78/179] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:21 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:21.780064 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:21.780684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:21.786711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.787383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.788175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.788619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.938383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:21.946600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0b773c46-9717-445d-aa66-7362fa09e74f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.170534 Jan 24 16:51:21.956008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 79/180] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:21 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:21.956008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:21.956008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:21.958572 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.959046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:21.960043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:21.960480 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.355507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1959aba1-231d-4638-ac0a-e8f034a3d4a0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 2.847300 Jan 24 16:51:24.356151 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 102/181] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:21 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 2850 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:24.363897 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:24.364592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:24.372328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.372714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.373496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.373934 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.388649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e3a565d6-e466-4fa9-8e6c-3b858afc2d90 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 15651 microversion: 2.20 time: 2.439638 Jan 24 16:51:24.389759 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 80/182] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:21 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 15651 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:24.394731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:24.395804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:24.403468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.404059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.404947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.405461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.494184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:24.503468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-38ba46a3-f68f-4379-a35b-33fe9c31948c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1274 microversion: 2.1 time: 0.112478 Jan 24 16:51:24.504310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 81/183] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:24 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:24.509539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:24.510149 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:24.516650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.517103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.517901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:24.519016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:24.539472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:24.548682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1bf9e650-f48c-48a7-b376-05c8aad7ea69 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.188342 Jan 24 16:51:24.549774 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 103/184] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:24 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:24.653545 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:24.661055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-23721b1f-657a-4c50-b218-3f9b2511313d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.155782 Jan 24 16:51:24.661650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 82/185] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:24 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:24.983656 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-9ab61e50-9855-464f-bfe0-2fd1a44a42a3 req-9855838a-b2eb-4958-8f01-b31ca3b24fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0fd420-7ca2-4584-bc5c-6d1ed60ca543", "name": "network-vif-plugged", "status": "completed", "tag": "c7a88162-0e4c-42a3-adce-9ee7d02857c6"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:24.988892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:24.988892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:25.011023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9ab61e50-9855-464f-bfe0-2fd1a44a42a3 req-9855838a-b2eb-4958-8f01-b31ca3b24fde service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.011781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9ab61e50-9855-464f-bfe0-2fd1a44a42a3 req-9855838a-b2eb-4958-8f01-b31ca3b24fde service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.063165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-9ab61e50-9855-464f-bfe0-2fd1a44a42a3 req-9855838a-b2eb-4958-8f01-b31ca3b24fde service nova] Creating event network-vif-plugged:c7a88162-0e4c-42a3-adce-9ee7d02857c6 for instance ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 on hv-cinder-82611 Jan 24 16:51:25.077141 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-9ab61e50-9855-464f-bfe0-2fd1a44a42a3 req-9855838a-b2eb-4958-8f01-b31ca3b24fde service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104715 Jan 24 16:51:25.080133 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 104/186] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:25.365343 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:25.366282 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:25.372729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.373178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.373980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.374406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.401196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:25.402814 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:25.410370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.410773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.411570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.412010 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.464627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f105669d-9cc2-407c-9f72-cfcde0084c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.102786 Jan 24 16:51:25.465264 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 83/187] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:25 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:25.510130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d4b81e19-adc8-4371-a194-80aa4ca5c1f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 17717 microversion: 2.20 time: 0.113662 Jan 24 16:51:25.511039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 105/188] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:25 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 17717 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:25.521790 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:25.522486 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:25.530078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.530531 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.531484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.531920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.567778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:25.568675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:25.575567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.576020 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.577538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.578151 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.613914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:25.622667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a7e9dbbd-2678-42fd-8b25-0e14d665f8ff tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1280 microversion: 2.1 time: 0.104983 Jan 24 16:51:25.623395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 84/189] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:25 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1280 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:25.677946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:25.678558 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:25.691433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.691883 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.692675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:25.693111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:25.831418 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:25.850084 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b4e350ee-0694-4754-ada1-9e449f0117ea tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.277118 Jan 24 16:51:25.850084 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 106/190] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:25 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:25.881604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:25.894532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2a3f69ac-9357-4d40-9346-385bfe02dad9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.220173 Jan 24 16:51:25.896182 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 85/191] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:25 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:26.479807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:26.480841 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:26.489190 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:26.489654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:26.490448 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:26.490921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:26.521725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:26.522676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:26.530899 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:26.531445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:26.532482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:26.532997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.120838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d1360c5b-03b4-48c8-be4a-53b3aafd9988 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 19976 microversion: 2.20 time: 2.603040 Jan 24 16:51:29.122211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 86/192] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:26 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 19976 bytes in 2605 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:29.129207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:29.129910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:29.144972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.145624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.145732 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3bda5a27-b05d-4c31-9f45-c10a2b8f45dd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 2.669968 Jan 24 16:51:29.146351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 107/193] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:26 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:29.156580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:29.157132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.157771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:29.157903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.169160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.169924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.172472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.173317 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.303298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:29.311241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6dca0281-888a-4771-93d0-e5347d610359 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.186909 Jan 24 16:51:29.312529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 87/194] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:29 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:29.317714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:29.318528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:29.325095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.325567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.326463 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.326925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.461252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:29.470147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-02d6a4cc-6d1a-4043-a446-a21d110b0741 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.322605 Jan 24 16:51:29.472452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 108/195] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:29 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:29.529439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:29.541403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8c9215e4-0d95-423e-9e69-d7a07d47f642 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.227390 Jan 24 16:51:29.543733 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 88/196] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:29 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:29.872038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-05733571-ecb1-4fd0-afec-8e836a16a2e4 req-97c893ae-a65f-4de1-963d-eae9002f61d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b09775-5279-4d04-af95-32c544e2b423", "tag": "efc223cc-bc5e-4cdf-a92f-b066f43ca860"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:29.873723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:29.873723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:29.882934 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-05733571-ecb1-4fd0-afec-8e836a16a2e4 req-97c893ae-a65f-4de1-963d-eae9002f61d9 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:29.883544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-05733571-ecb1-4fd0-afec-8e836a16a2e4 req-97c893ae-a65f-4de1-963d-eae9002f61d9 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:29.895091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-05733571-ecb1-4fd0-afec-8e836a16a2e4 req-97c893ae-a65f-4de1-963d-eae9002f61d9 service nova] Creating event network-changed:efc223cc-bc5e-4cdf-a92f-b066f43ca860 for instance e2b09775-5279-4d04-af95-32c544e2b423 on hv-cinder-82611 Jan 24 16:51:29.903799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-05733571-ecb1-4fd0-afec-8e836a16a2e4 req-97c893ae-a65f-4de1-963d-eae9002f61d9 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036872 Jan 24 16:51:29.905501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 109/197] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:30.134147 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:30.143555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:30.149933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.150578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.151612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.152202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.159581 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:30.161897 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:30.169232 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.169968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.170996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.171613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.293604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2d4709a9-2eb8-44c0-929a-0dd5a14bea82 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 21332 microversion: 2.20 time: 0.163486 Jan 24 16:51:30.295324 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 89/198] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:30 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 21332 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:30.298008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7c303376-40ce-4778-8c3f-db66a32579f5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.142464 Jan 24 16:51:30.301497 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 110/199] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:30 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:51:30.330603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:30.331626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:30.340245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.340796 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.341771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.342302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.489847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:30.491256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:30.498796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.499316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.502376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.502376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.598397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:30.608374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a53be7ee-5165-437d-919d-1067a18566be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.281676 Jan 24 16:51:30.614684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 90/200] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:30 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:30.621965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:30.622926 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:30.636396 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.638041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.639848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:30.640352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:30.775312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:30.783275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4640014d-20f1-4dac-8e00-fc0d6fed1e82 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1317 microversion: 2.1 time: 0.297316 Jan 24 16:51:30.795423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 111/201] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:30 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:30.825602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:30.833796 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a69ef1a7-f154-4a75-9206-df42046d2f0f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.217714 Jan 24 16:51:30.834286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 91/202] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:30 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:31.305763 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:31.307278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:31.308436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:31.309546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:31.315223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.315866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.316819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.317107 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.317540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.317917 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.319311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.320484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.411906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1b2ea53a-d708-4e7f-bb2f-1a9202a26f47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 14 microversion: 2.1 time: 0.106900 Jan 24 16:51:31.412765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 92/203] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:31 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:51:31.478846 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3bd2c185-3bfd-4de7-970b-b03fd5b7c88f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 22534 microversion: 2.20 time: 0.176599 Jan 24 16:51:31.479950 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 112/204] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:31 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 22534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:31.632620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:31.633523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:31.641983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.642568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.643655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.644190 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.800848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:31.801928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:31.812331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.813105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.814289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.815621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.853917 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:31.861741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5bcca05d-094e-45a5-8aff-826f05f094a6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.234098 Jan 24 16:51:31.863768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 93/205] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:31 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:31.868737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:31.869561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:31.875707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.876165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:31.876967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:31.877417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.064906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:32.075835 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9c64a01f-4f42-4dd5-a9b4-83ba2af32ec5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.210632 Jan 24 16:51:32.077245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 94/206] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:31 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:32.127943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:32.141906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-140a036c-480b-4b86-b210-f41c89518882 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1501 microversion: 2.1 time: 0.345215 Jan 24 16:51:32.142510 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 113/207] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:31 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:32.425396 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:32.426382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:32.435643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.436136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.436965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.437428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.490638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:32.492322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:32.498887 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.499539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.500547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.501505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.558055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c5cc27e2-c517-4063-a22d-bb75b7c71f74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 1726 microversion: 2.1 time: 0.136096 Jan 24 16:51:32.558911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 95/208] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:32 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 1726 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:32.679867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d7ea272a-131c-4811-8f50-11a04e2bf551 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 23208 microversion: 2.20 time: 0.192018 Jan 24 16:51:32.680523 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 114/209] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:32 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 23208 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:32.880525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:32.881333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:32.882607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:32.882951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:32.891816 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.892533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.893539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.894160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.912863 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.915088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.915952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:32.916388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:32.947063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:51:33.072940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:33.079875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d91434fb-e0f0-40b0-b3db-83b16ecb5eda tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "DELETE /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 204 len: 0 microversion: 2.1 time: 0.202971 Jan 24 16:51:33.080889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 96/210] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:51:32 2022] DELETE /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:51:33.085091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-866abdad-63fa-4519-b9df-fe36e712a302 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.208371 Jan 24 16:51:33.089894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:33.090688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:33.096204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 115/211] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:32 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:33.097312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.097868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.098739 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.099271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.102597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:33.103248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:33.109933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.110381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.111202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.111642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.255132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:33.263005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3ccb955e-755d-4dce-9898-22ef8920015c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1507 microversion: 2.1 time: 0.177519 Jan 24 16:51:33.263760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 97/212] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:33 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:33.305531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:33.310147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dcf32148-e3d9-40d9-ad61-4a9b6588d376 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.212180 Jan 24 16:51:33.311069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 116/213] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:33 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:33.570043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:33.571071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:33.577845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.578291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.579822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.580254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.691536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:33.692806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:33.699683 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.700201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.701158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:33.701588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:33.755148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cadc7ae4-9404-4560-bc1f-c3e460699faf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 6451 microversion: 2.1 time: 0.189126 Jan 24 16:51:33.755760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 98/214] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:33 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 6451 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:34.105214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:34.105901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:34.112672 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.113114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.113887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.114320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.262869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:34.270122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e574103d-fea1-48f5-baba-53e51042e436 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.168842 Jan 24 16:51:34.270686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 99/215] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:34 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:34.279907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:34.280512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:34.286374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.286850 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.287621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.288046 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.457659 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:34.465584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0192d99d-5820-40bf-aab7-4943f1824f3a tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1507 microversion: 2.1 time: 0.188998 Jan 24 16:51:34.466174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 100/216] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:34 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:34.470354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:34.470994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:34.476731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.477189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.477971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.478416 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.626171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:34.634326 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1d9f066c-0b04-4aa4-a1b0-2a0a23a17fbf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.167225 Jan 24 16:51:34.634925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 101/217] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:34 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:34.765274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:34.766244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:34.773631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.774084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:34.774905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:34.775348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:36.973048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9c807d18-3bca-48cb-918e-16b1fe33af8b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 25388 microversion: 2.20 time: 3.285201 Jan 24 16:51:36.973713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 117/218] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:33 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 25388 bytes in 3287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:36.979479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:36.980185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:36.986973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:36.987424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:36.988206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:36.988646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.003707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c23e79b-8392-4cce-b209-1dab96d54972 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 12971 microversion: 2.1 time: 2.241927 Jan 24 16:51:37.008280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 102/219] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:34 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 12971 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:37.010955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:37.011756 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:37.018878 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.019459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.020322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.020859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.131933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:37.139463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-429ac5cf-e9e8-42f7-94ec-38d0954917dd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.164567 Jan 24 16:51:37.140081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 118/220] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:36 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:37.149710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:37.149710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:37.159759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.159885 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:37.160267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.161071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.161517 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.168215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-61dec4a3-8a75-4eac-8200-f78bffe33cb3 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1507 microversion: 2.1 time: 0.162002 Jan 24 16:51:37.168778 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 103/221] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:37 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:37.291080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:37.298374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2d3ab1fc-b31d-48b0-b8df-cd175e922360 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.157211 Jan 24 16:51:37.298980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 119/222] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:37 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:37.973362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-feded0eb-019f-419a-9ed1-5e24a54e2d34 req-5d2ff402-dd3a-478f-82da-1e614f171398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b09775-5279-4d04-af95-32c544e2b423", "name": "network-vif-plugged", "status": "completed", "tag": "efc223cc-bc5e-4cdf-a92f-b066f43ca860"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:37.975439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:37.975439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:51:37.984992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-feded0eb-019f-419a-9ed1-5e24a54e2d34 req-5d2ff402-dd3a-478f-82da-1e614f171398 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.985159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:37.985633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-feded0eb-019f-419a-9ed1-5e24a54e2d34 req-5d2ff402-dd3a-478f-82da-1e614f171398 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.986219 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:37.993661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.994204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.995093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:37.995603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:37.998735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-feded0eb-019f-419a-9ed1-5e24a54e2d34 req-5d2ff402-dd3a-478f-82da-1e614f171398 service nova] Creating event network-vif-plugged:efc223cc-bc5e-4cdf-a92f-b066f43ca860 for instance e2b09775-5279-4d04-af95-32c544e2b423 on hv-cinder-82611 Jan 24 16:51:38.003829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-feded0eb-019f-419a-9ed1-5e24a54e2d34 req-5d2ff402-dd3a-478f-82da-1e614f171398 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Jan 24 16:51:38.004701 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 104/223] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:38.017851 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:38.019198 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:38.026097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.026699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.027714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.028150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.116055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1698ee5d-2af0-47dc-8f6e-4339cc0153a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 25844 microversion: 2.20 time: 0.134867 Jan 24 16:51:38.120241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 120/224] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:37 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 25844 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:38.162206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:38.163553 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:38.170772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.171434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.172214 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.172639 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.181201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c165be2-6087-4488-b9d4-159aa1e2bf47 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 15064 microversion: 2.1 time: 0.167765 Jan 24 16:51:38.181853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 105/225] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:38 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 15064 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:38.189018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:38.190463 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:38.198427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.199194 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.200452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.201115 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.373111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:38.375791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:38.380528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dc558e3d-4e2c-4c96-8c9a-fec907ae939d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.226344 Jan 24 16:51:38.381650 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 121/226] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:38 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:38.384229 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7d52b092-5855-4a14-b829-1ff72c5b521f tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1507 microversion: 2.1 time: 0.200975 Jan 24 16:51:38.386436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:38.387398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:38.393386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.394181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.395276 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:38.395721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:38.402997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 106/227] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:38 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:38.537996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:38.546451 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f47fa32b-ffb6-4a7d-8bb0-b22dea11438b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.163508 Jan 24 16:51:38.547055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 122/228] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:38 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:39.128002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:39.128859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:39.136031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:39.136473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:39.137246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:39.137680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:39.192801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:39.194288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:39.200676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:39.201122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:39.201896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:39.202330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.392693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8c544e18-7545-42d6-af79-6690f97db357 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 27740 microversion: 2.20 time: 3.268194 Jan 24 16:51:42.393267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 107/229] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:39 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 27740 bytes in 3270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:42.398073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:42.398933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:42.405891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.406344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.407165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.407603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.426708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7741e083-accc-4c29-9b90-b4e2400f18a4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 19446 microversion: 2.1 time: 3.237636 Jan 24 16:51:42.428285 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 123/230] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:39 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 19446 bytes in 3239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:42.433152 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:42.433876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:42.441349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.441929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.442929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.443493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.545000 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:42.552271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0e889bcf-759c-4d2e-aab9-5a1d3468a75b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.157865 Jan 24 16:51:42.552845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 108/231] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:42 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:42.557087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:42.557696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:42.563479 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.563932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.564990 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:42.565430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:42.585475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:42.593513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a5656501-309a-4c45-861f-7858a198c814 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1507 microversion: 2.1 time: 0.164952 Jan 24 16:51:42.594100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 124/232] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:42 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:42.698714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:42.706204 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7622aa93-5c03-4c25-9e8b-6d8ea16ec984 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.152416 Jan 24 16:51:42.706791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 109/233] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:42 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:43.396998 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-8b586477-b05f-48f5-8421-5262c9e4c21e req-10217dd4-7a76-4fab-ac66-0807d76f1992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0fd420-7ca2-4584-bc5c-6d1ed60ca543", "name": "network-vif-deleted", "tag": "c7a88162-0e4c-42a3-adce-9ee7d02857c6"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:43.399099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:43.399099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:43.405707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:43.407285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:43.407676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8b586477-b05f-48f5-8421-5262c9e4c21e req-10217dd4-7a76-4fab-ac66-0807d76f1992 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:43.408116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8b586477-b05f-48f5-8421-5262c9e4c21e req-10217dd4-7a76-4fab-ac66-0807d76f1992 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:43.415151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:43.415925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:43.416858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:43.417300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:43.421866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-8b586477-b05f-48f5-8421-5262c9e4c21e req-10217dd4-7a76-4fab-ac66-0807d76f1992 service nova] Creating event network-vif-deleted:c7a88162-0e4c-42a3-adce-9ee7d02857c6 for instance ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 on hv-cinder-82611 Jan 24 16:51:43.426762 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-8b586477-b05f-48f5-8421-5262c9e4c21e req-10217dd4-7a76-4fab-ac66-0807d76f1992 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 Jan 24 16:51:43.427767 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 125/234] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:43.439632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:43.441012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:43.447889 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:43.448346 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:43.449258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:43.449698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.199962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-57f47d4f-ef5e-4569-8e93-2d731993beb5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28161 microversion: 2.20 time: 2.798335 Jan 24 16:51:46.201131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 110/235] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:43 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28161 bytes in 2800 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:46.206311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:46.207113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:46.214649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.215129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.215905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.216336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.271983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c6c3d593-dc7d-471e-bf06-5ff1d7c73fb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 23797 microversion: 2.1 time: 2.836411 Jan 24 16:51:46.273447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 126/236] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:43 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 23797 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:51:46.278393 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:46.279303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:46.285902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.286343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.287152 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.287584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.330498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.330987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.331443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lazy-loading 'fault' on Instance uuid ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:51:46.363966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:46.371499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c7a105f3-1157-4ae6-8b5e-895842488263 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1322 microversion: 2.1 time: 0.169549 Jan 24 16:51:46.372008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 111/237] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:46 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:46.377758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:46.382634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:46.383834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:46.385552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-24f57a84-7822-48df-99f5-f89f687a46e2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 200 len: 1307 microversion: 2.1 time: 0.110807 Jan 24 16:51:46.386174 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 127/238] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:46 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:46.389714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.390168 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.390982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:46.391425 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:46.520688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:46.528353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8b19a25a-e38e-4694-a385-3aaaeaea1a05 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.149470 Jan 24 16:51:46.528920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 112/239] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:46 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:47.215115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:47.216528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.227194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.227875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.229082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.229742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.284746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:47.285761 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.293628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.294159 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.295143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.295601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.337600 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-075844c9-28f7-4858-81c4-d77e3e366418 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28450 microversion: 2.20 time: 0.128891 Jan 24 16:51:47.341582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 128/240] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:47 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28450 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:47.388875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1cb568e8-b3e8-432e-a8c8-7329e724e3bc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 24486 microversion: 2.1 time: 0.108310 Jan 24 16:51:47.389140 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:47.390191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 113/241] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:47 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 24486 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:47.390301 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.397779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.398813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.399611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.400054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.403024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:47.403730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: ea0fd420-7ca2-4584-bc5c-6d1ed60ca543] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.411310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.411438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.412314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.412649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.427355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] HTTP exception thrown: Instance ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 could not be found. Jan 24 16:51:47.427966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Returning 404 to user: Instance ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:47.428840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-483e4472-e4c0-4fb4-849e-f0107b61b162 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543" status: 404 len: 111 microversion: 2.1 time: 0.030974 Jan 24 16:51:47.430295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 114/242] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:47 2022] GET /compute/v2.1/servers/ea0fd420-7ca2-4584-bc5c-6d1ed60ca543 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 16:51:47.545655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:47.546493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.560794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.561653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.563153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.564196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.564629 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:47.574999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b0fddf67-dd53-43b1-8bee-38305c3296eb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1513 microversion: 2.1 time: 0.188418 Jan 24 16:51:47.585477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 129/243] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:47 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:47.590140 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1155177820", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "a212a263-addf-4bd8-b46c-96697d6542c3"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:47.641902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] validate_networks() for [('a212a263-addf-4bd8-b46c-96697d6542c3', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:51:47.716885 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:47.724464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c100cc3-7664-437a-aeef-1c30f9e48422 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.182476 Jan 24 16:51:47.725034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 115/244] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:47 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:47.730781 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f500d057-0f78-43f7-84ac-206880924368"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:47.731860 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:47.737682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.738131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.738972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:47.739406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:47.823755 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Invalid volume: volume f500d057-0f78-43f7-84ac-206880924368 is already attached to instances: ffea6bfd-3cc1-438b-b7c3-29079c646252 Jan 24 16:51:47.824121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 400 to user: Invalid volume: volume f500d057-0f78-43f7-84ac-206880924368 is already attached to instances: ffea6bfd-3cc1-438b-b7c3-29079c646252 {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:51:47.824962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-52201f8e-10b4-4d27-aaa7-799721594069 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099026 Jan 24 16:51:47.825694 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 116/245] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:51:47 2022] POST /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:51:48.009932 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:51:48.010355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:51:48.010935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:51:48.011305 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:51:48.011745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:51:48.020170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:48.020757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.020850 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.021286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.022116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.022561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.027910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.028360 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.029144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.029578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.039196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Getting quotas for project e5e86d82e0524fd380e44df98739cfa3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:51:48.043162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Getting quotas for user 54f058a8f1014fde9d4ec742e8174d00 and project e5e86d82e0524fd380e44df98739cfa3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:51:48.054647 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:51:48.057364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:51:48.109347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8911e108-cbbf-48bd-9d22-8c79da0e363c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.522627 Jan 24 16:51:48.110598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 130/246] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:51:47 2022] POST /compute/v2.1/servers => generated 382 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:51:48.126359 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9c22edad-c565-4f8c-8bcf-88babf240226 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:48.130126 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9c22edad-c565-4f8c-8bcf-88babf240226 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.168893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'services' on Instance uuid ffea6bfd-3cc1-438b-b7c3-29079c646252 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:51:48.198591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9c22edad-c565-4f8c-8bcf-88babf240226 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:48.206378 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9c22edad-c565-4f8c-8bcf-88babf240226 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1218 microversion: 2.1 time: 0.086988 Jan 24 16:51:48.207639 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 131/247] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:48 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:48.315301 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-46542912-3572-4c96-b06b-4756ad136c3c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments/f500d057-0f78-43f7-84ac-206880924368" status: 202 len: 0 microversion: 2.1 time: 0.298519 Jan 24 16:51:48.316196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 117/248] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:51:48 2022] DELETE /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments/f500d057-0f78-43f7-84ac-206880924368 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:48.328122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:48.329122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.337426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.337904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.338682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.339340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.349803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:48.351429 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.364075 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.364524 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.365404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.367729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.385312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a7b57ba3-6c2d-4b78-9167-ecb5a0898572 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061628 Jan 24 16:51:48.391182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 132/249] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:51:48 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:48.401886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:48.403073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.410222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.411059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.412173 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.412970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.498871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-22c5496e-518b-4f58-9a6d-0734f52e723c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28450 microversion: 2.20 time: 0.152390 Jan 24 16:51:48.503976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 118/250] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:48 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:51:48.519191 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-82425922-7ab1-4fab-8274-a7bb557cdfbc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 25233 microversion: 2.1 time: 0.120480 Jan 24 16:51:48.519858 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 133/251] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:48 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 25233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:51:48.746216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:48.747084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:48.753673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.754054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.754881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:48.755313 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:48.902729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:48.912797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-84075285-5131-4cca-9dc3-a423e53fc927 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.173063 Jan 24 16:51:48.914026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 119/252] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:48 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:49.223351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:49.224284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:49.232682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.233138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.233985 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.234453 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.314865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:49.326024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6da80766-4a66-4616-8d51-9c697f47290c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1270 microversion: 2.1 time: 0.106728 Jan 24 16:51:49.326966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 134/253] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:49 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:49.400392 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:49.401888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:49.408032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.408855 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.409837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.410693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.444120 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-03480576-975d-405e-8de9-fb4ddedb921d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050302 Jan 24 16:51:49.449500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 120/254] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:51:49 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:51:49.512888 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:49.514485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:49.524639 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.525370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.526716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.527328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.540787 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:49.541885 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:49.555967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.556813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.559390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.560957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.631806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e5bc0814-64e6-4f4a-82d6-7a5ce06d5892 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28450 microversion: 2.20 time: 0.124254 Jan 24 16:51:49.632524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 135/255] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:49 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28450 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:49.701108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f62a69f6-75aa-4562-8792-dac8472a5653 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 25681 microversion: 2.1 time: 0.172601 Jan 24 16:51:49.701980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 121/256] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:49 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 25681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:49.937707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:49.938640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:49.951108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.951625 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:49.952706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:49.953179 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.198103 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:50.206435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-166d6cc0-e7b9-4380-8dc5-54266782f938 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.273286 Jan 24 16:51:50.207700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 136/257] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:49 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:50.345266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:50.346471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:50.355515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.355967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.356760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.357201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.431925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:50.440421 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9d6888e3-c60d-45b1-9557-b681276d3625 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1276 microversion: 2.1 time: 0.100392 Jan 24 16:51:50.441873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 122/258] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:50 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:50.456829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:50.457992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:50.466641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.467420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.468394 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.469668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.501764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5bc670b9-fd1c-49b4-a236-8a1f45abacc2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048951 Jan 24 16:51:50.502877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 137/259] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:51:50 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:51:50.644014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:50.645466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:50.653132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.653765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.654903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.655493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.714848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:50.716626 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:50.724239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.724715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.725508 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:50.725969 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:50.835782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ede3e1e2-47c7-4e05-96b8-e29a2683b2f8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28465 microversion: 2.20 time: 0.193735 Jan 24 16:51:50.837630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 123/260] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:50 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:50.845672 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1673567130", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "d2067982-5a38-46c1-8ec9-527550d6c2b1"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:50.890612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2fb206c7-d58b-4664-b53e-0044bd6feb0e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 26189 microversion: 2.1 time: 0.181216 Jan 24 16:51:50.892025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 138/261] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:50 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 26189 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:50.950362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] validate_networks() for [('d2067982-5a38-46c1-8ec9-527550d6c2b1', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:51:51.224913 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:51.225707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:51.233002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.233649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.234740 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.235386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.464142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:51:51.464644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:51:51.465387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:51:51.465866 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:51:51.466366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:51:51.485122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.485568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.486388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.486846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.505279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:51:51.511248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for user feb8ddf0abd84c1caed8501c57b56f20 and project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:51:51.523986 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:51:51.526498 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:51:51.576846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-939aca55-7bba-428f-80d8-0facf3102df4 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.736855 Jan 24 16:51:51.577660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 124/262] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:51:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:51:51.590971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:51.592387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:51.606945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.607553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.608424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.608932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.702468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:51.711002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b187f941-50b7-4aa6-9e02-f8747a7efa36 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.490083 Jan 24 16:51:51.711587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 139/263] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:51 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:51.726708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c3c55f85-5453-43e3-84b6-d55b1b321ece tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:51.727375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c3c55f85-5453-43e3-84b6-d55b1b321ece tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:51.774373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:51.783388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dedd72fd-7b19-4ef4-96ce-0c67dc7d455c tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.198570 Jan 24 16:51:51.783934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 125/264] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:51 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:51.807298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c3c55f85-5453-43e3-84b6-d55b1b321ece tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:51.818705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c3c55f85-5453-43e3-84b6-d55b1b321ece tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1222 microversion: 2.1 time: 0.106101 Jan 24 16:51:51.821015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 140/265] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:51 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:51.848603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:51.850080 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:51.856974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.857422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.858205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.858651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.868663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-8bf6abda-a5a2-4739-9697-3be0e87a91b7 req-ea6ed8cb-27a9-4c3f-9b51-702fc38a3473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93bef71-7362-4652-86dd-a0ef15e0e727", "tag": "089933b7-b1b4-46c7-ad20-aa745b6e9760"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:51.870214 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:51:51.870214 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:51:51.879630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8bf6abda-a5a2-4739-9697-3be0e87a91b7 req-ea6ed8cb-27a9-4c3f-9b51-702fc38a3473 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.885462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8bf6abda-a5a2-4739-9697-3be0e87a91b7 req-ea6ed8cb-27a9-4c3f-9b51-702fc38a3473 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.900836 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-8bf6abda-a5a2-4739-9697-3be0e87a91b7 req-ea6ed8cb-27a9-4c3f-9b51-702fc38a3473 service nova] Creating event network-changed:089933b7-b1b4-46c7-ad20-aa745b6e9760 for instance a93bef71-7362-4652-86dd-a0ef15e0e727 on hv-cinder-82611 Jan 24 16:51:51.907198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-8bf6abda-a5a2-4739-9697-3be0e87a91b7 req-ea6ed8cb-27a9-4c3f-9b51-702fc38a3473 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044163 Jan 24 16:51:51.908570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 141/266] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:51:51.916790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:51.918328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:51.925223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.925675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.926774 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:51.927360 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:51.973386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-261b317f-43d7-4eb4-bf9b-a4c7dc830f7d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28739 microversion: 2.20 time: 0.128327 Jan 24 16:51:51.974091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 126/267] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:51 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28739 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:52.101067 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2d363d1e-8f38-4219-837a-923ff34f1bb1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 26651 microversion: 2.1 time: 0.189875 Jan 24 16:51:52.101767 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 142/268] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:51 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 26651 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:51:52.733464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:52.734254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:52.742185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.742569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.743391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.743831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.801516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:52.802322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:52.809891 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.810419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.811309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.811838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.878727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:52.886730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-be8af0b2-ba91-4556-a02f-11a1cec6c97a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.157459 Jan 24 16:51:52.887342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 127/269] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:52 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:52.891500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:52.892136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:52.898601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.899102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.899943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.900378 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.957663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:52.965669 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e9972576-4a4c-4245-89d1-0bc5d7b3e7fc tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.168174 Jan 24 16:51:52.966436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 143/270] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:52 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:51:52.970715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:52.978668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c49246b4-dd49-48d2-81bc-3763ad45fab2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1274 microversion: 2.1 time: 0.090389 Jan 24 16:51:52.979276 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 128/271] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:52 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:52.985393 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:52.986318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:52.992862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.993315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:52.994097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:52.994534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:53.115438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:53.116958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:53.123088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:53.123534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:53.124304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:53.124735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:55.856339 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-73986e23-973f-4728-9260-9b69f6b61f4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 2.874410 Jan 24 16:51:55.866577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 144/272] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:52 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 2876 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:55.866577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:55.866577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:55.871102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:55.871619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:55.872955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:55.873419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:55.955582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3c65d14f-4f9a-4b66-8f51-1ff50a1713b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 27646 microversion: 2.1 time: 2.843551 Jan 24 16:51:55.956528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 129/273] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:53 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 27646 bytes in 2845 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:55.973427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:55.974241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:55.981711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:55.982114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:55.982948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:55.983391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.102132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:56.110282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-399d80af-9d71-46fc-9015-6af21c6e5078 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.251714 Jan 24 16:51:56.121993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 145/274] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:55 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:56.127992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:56.128776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:56.136638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.137436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.138475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.139166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.284094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:56.297811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-18cadc0b-4559-42c0-90e8-79613ca2da01 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1282 microversion: 2.1 time: 0.172005 Jan 24 16:51:56.298742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 146/275] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:56 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:56.390581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:56.398905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2f59052e-98ae-4fb0-84c8-c25876d3d1aa tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.437405 Jan 24 16:51:56.399533 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 130/276] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:55 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:56.873633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:56.876230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:56.882601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.883106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.883919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.884583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.967109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:51:56.968142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:56.976079 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.976535 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:56.977337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:56.977856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.504803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3f05ed10-d65c-4317-b4e9-3dea7827bf96 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 27943 microversion: 2.1 time: 2.541139 Jan 24 16:51:59.505466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 131/277] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:51:56 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 27943 bytes in 2543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:51:59.511517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:59.512212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:59.518525 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.519016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.519800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.520234 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.534884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-23e847b1-0d28-4c33-a94d-f9d75f9a5fdb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 2.664775 Jan 24 16:51:59.539988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 147/278] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:51:56 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:51:59.541461 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:59.542259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:59.549431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.550151 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.551215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.551796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.650068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:59.659286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-870b49ef-d77b-43d6-b1ce-2d6bf29707bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1280 microversion: 2.1 time: 0.122127 Jan 24 16:51:59.668269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 148/279] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:59 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:59.668269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:51:59.668269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:51:59.670369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:59.677596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.678064 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.678913 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:51:59.679029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a63fbcb9-9081-4ea6-87c0-332b2de79204 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.171246 Jan 24 16:51:59.679370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:51:59.679509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 132/280] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:59 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:51:59.917764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:51:59.927102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dfe5619d-ba16-49ae-8983-86f16453699d tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.266015 Jan 24 16:51:59.927564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 149/281] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:51:59 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:00.517276 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:00.518270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:00.525663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:00.526109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:00.526934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:00.527370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:00.547544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:00.548459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:00.555261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:00.555741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:00.556529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:00.556963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.151420 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1f180c48-2340-44ee-b76d-4600e9a265c1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28061 microversion: 2.1 time: 2.637566 Jan 24 16:52:03.152768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 133/282] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:00 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28061 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:03.157925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:03.158680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:03.166163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-53a75eff-9053-4661-a41a-2b8cb1b84052 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 2.621967 Jan 24 16:52:03.170663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 150/283] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:00 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:03.170846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.170846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.170846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.170846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.173269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:03.174005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:03.183710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.184170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.184971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.185407 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.323311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:03.330737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-45c1c106-8b2c-494b-beaa-788ecb112810 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.177056 Jan 24 16:52:03.331580 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 134/284] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:03 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:03.339509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:03.340859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:03.347444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.347894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.348683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.349118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.421749 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:03.429582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ea46f05c-5785-4800-a768-217a42d337bf tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.261544 Jan 24 16:52:03.430262 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 151/285] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:03 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:03.495425 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:03.503354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-69328832-c83a-41f2-81fb-9fc983af0831 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.167401 Jan 24 16:52:03.503916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 135/286] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:03 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:03.754117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-ab429b63-3884-41f1-a355-41a7497ade94 req-aed6f092-8cf4-4c04-a3d8-93f6630cedef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ca6098-0099-41ae-a01a-a19e52f1bc70", "tag": "1c00f2bb-a862-432a-8749-d007bd44785f"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:03.755691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:03.755691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:52:03.762987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ab429b63-3884-41f1-a355-41a7497ade94 req-aed6f092-8cf4-4c04-a3d8-93f6630cedef service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:03.763427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ab429b63-3884-41f1-a355-41a7497ade94 req-aed6f092-8cf4-4c04-a3d8-93f6630cedef service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:03.778830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-ab429b63-3884-41f1-a355-41a7497ade94 req-aed6f092-8cf4-4c04-a3d8-93f6630cedef service nova] Creating event network-changed:1c00f2bb-a862-432a-8749-d007bd44785f for instance b5ca6098-0099-41ae-a01a-a19e52f1bc70 on hv-cinder-82611 Jan 24 16:52:03.788511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-ab429b63-3884-41f1-a355-41a7497ade94 req-aed6f092-8cf4-4c04-a3d8-93f6630cedef service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037758 Jan 24 16:52:03.790111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 152/287] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:04.164152 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:04.165140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:04.172100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.172617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.173753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.174378 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.181047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:04.182446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:04.191005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.191451 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.192438 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.192870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.279273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7d685948-b626-4d78-8556-85c27056c8e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 0.119481 Jan 24 16:52:04.280253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 136/288] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:04 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:04.291267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b717c46d-318e-40cc-918a-71175417e02e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.116296 Jan 24 16:52:04.295224 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 153/289] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:04 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:04.350202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:04.351316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:04.358987 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.359499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.360323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.360772 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.447616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:04.448340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:04.455545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.455984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.456800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.457239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.522407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:04.532735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-54834bd5-050e-4ebe-9a2e-50042dcc08ec tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.186884 Jan 24 16:52:04.533520 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 137/290] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:04 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:04.538503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:04.539410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:04.547400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.547855 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.548798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:04.549245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:04.618028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:04.626073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e8c310eb-1d57-4f12-8c55-96b2aa47c04d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.183462 Jan 24 16:52:04.627536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 154/291] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:04 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:04.706169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:04.715003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6d48ceb9-5132-4d36-9980-4ad3df8f0165 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.180147 Jan 24 16:52:04.715584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 138/292] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:04 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:05.290286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:05.291244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:05.297642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:05.298069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:05.298894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:05.299343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:05.303386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:05.304315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:05.311005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:05.311462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:05.312264 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:05.312708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.378155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ba9e8319-4a4f-442a-b4ba-e724e8928f19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 2.078851 Jan 24 16:52:07.379214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 139/293] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:05 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:07.384270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:07.384961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:07.387532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-84bd7f26-7093-42dc-bf41-1eace504bbca tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 2.100720 Jan 24 16:52:07.390112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 155/294] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:05 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:07.391919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.392375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.393154 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.393585 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.394241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:07.394963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:07.406154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.406617 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.407466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.407905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.535848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:07.544100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-aa81c2cb-8a0e-4c8f-af99-fbb3ac45bc4d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.163854 Jan 24 16:52:07.546151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 140/295] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:07 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:07.550619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:07.551462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:07.557676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.558209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.559117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:07.559625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:07.651792 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:07.659753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-59e05f00-a0f1-44c2-8183-aa70dfd60cd1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.269137 Jan 24 16:52:07.664052 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 156/296] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:07 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:07.703858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:07.712002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f686d7ce-7e3d-4abf-b039-c4bdb8884962 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.164839 Jan 24 16:52:07.712566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 141/297] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:07 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:08.389438 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:08.393694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:08.400266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:08.401391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.401939 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.402854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.403639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:08.403769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.410991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.410991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.411333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.411804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.503780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-50e7b948-e8a5-46ea-b2b6-0c056c9631c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.118023 Jan 24 16:52:08.509539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 157/298] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:08 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:08.515782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-249bcb0e-bf3d-4615-bc89-6162a37d90af tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 0.119907 Jan 24 16:52:08.516423 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 142/299] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:08 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:08.562334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:08.563326 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:08.571544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.571995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.572787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.573222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.676894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:08.678468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:08.685655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.685771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.686542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.687126 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.719757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:08.728993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-daa0ca6e-2118-47ec-9ed1-3d4ea3575d21 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.171124 Jan 24 16:52:08.729572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 158/300] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:08 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:08.744447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:08.745111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:08.751089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.751538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.752317 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:08.752751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:08.832863 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:08.840941 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6567685d-6a50-4952-85eb-99cbc8bb175e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.167997 Jan 24 16:52:08.841516 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 143/301] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:08 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:08.893326 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:08.901447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6df00292-c1d5-412f-b8d5-62312ae2f9a2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.162032 Jan 24 16:52:08.902015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 159/302] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:08 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:09.517748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:09.518728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:09.528805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.529260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.529738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:09.530219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.530497 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.531819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:09.544242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.544702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.545505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.545943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.617562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-218212c2-3a82-49d8-af1b-672fe71a37f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.103459 Jan 24 16:52:09.618599 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 144/303] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:09 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:09.627588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8e44526a-f066-4a34-a783-5e53308a8dad tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 0.102728 Jan 24 16:52:09.628333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 160/304] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:09 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:09.746340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:09.746975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:09.754087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.754537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.755651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.756449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.861200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:09.862058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:09.879643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.880928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.882139 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:09.883283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:09.987279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:09.995883 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-790a3f9d-f0f9-4b30-b0d5-960f845065d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.253407 Jan 24 16:52:09.996616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 145/305] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:09 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:10.009020 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:10.009634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:10.019058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.019511 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.020301 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.022978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.120465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:10.130309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c323aa41-c5ab-4bde-bcce-1f5a96644a2b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.274438 Jan 24 16:52:10.143738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 161/306] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:09 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:10.224340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-dfe61727-84ad-4711-936c-3b18042401f6 req-b00b30f4-9fcc-4b83-a763-a259d8464e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93bef71-7362-4652-86dd-a0ef15e0e727", "name": "network-vif-plugged", "status": "completed", "tag": "089933b7-b1b4-46c7-ad20-aa745b6e9760"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:10.226137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:10.226137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:52:10.244102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-dfe61727-84ad-4711-936c-3b18042401f6 req-b00b30f4-9fcc-4b83-a763-a259d8464e0b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.244566 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-dfe61727-84ad-4711-936c-3b18042401f6 req-b00b30f4-9fcc-4b83-a763-a259d8464e0b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.264051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-dfe61727-84ad-4711-936c-3b18042401f6 req-b00b30f4-9fcc-4b83-a763-a259d8464e0b service nova] Creating event network-vif-plugged:089933b7-b1b4-46c7-ad20-aa745b6e9760 for instance a93bef71-7362-4652-86dd-a0ef15e0e727 on hv-cinder-82611 Jan 24 16:52:10.270129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:10.270588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-dfe61727-84ad-4711-936c-3b18042401f6 req-b00b30f4-9fcc-4b83-a763-a259d8464e0b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050034 Jan 24 16:52:10.271976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 162/307] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:10.285083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-066f9555-bb48-4229-a4a1-c8e438cd7ec4 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.280418 Jan 24 16:52:10.291049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 146/308] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:09 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:10.630469 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:10.631497 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:10.638789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.639596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:10.640071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.640515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:10.640618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.641103 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.647778 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.648233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.649043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:10.650078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:10.752079 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-28edb401-7407-4697-9ea0-2e6158609a8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 0.116637 Jan 24 16:52:10.752821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 147/309] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:10 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:10.769824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d2868d74-4069-4a4b-8ea0-1fe6cc5273ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.142915 Jan 24 16:52:10.770475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 163/310] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:10 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:11.015022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:11.015022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:11.022017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.022483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.023300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.023740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.160601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:11.161294 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:11.170391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.170868 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.171654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.172091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.183791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:11.191715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6ea386cd-ac26-47ff-b7d7-4589a56cd7d9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.182506 Jan 24 16:52:11.192485 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 148/311] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:11 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:11.303403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:11.304058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:11.310726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.311200 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.311978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.312569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.332406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:11.340533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6340b61c-6259-48b9-99cc-7a476aeec690 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.183901 Jan 24 16:52:11.341274 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 164/312] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:11 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:11.453196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:11.461583 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-91b1e0ec-f75b-4891-893e-35aee659acb1 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.162552 Jan 24 16:52:11.462251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 149/313] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:11 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:11.763244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:11.764235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:11.770512 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.771015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.772417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.772854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.781995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:11.782956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:11.790965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.791290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.792604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:11.793203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:11.883992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-94bcaa2f-f04e-457d-8647-8bcdebb70a91 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28175 microversion: 2.1 time: 0.124198 Jan 24 16:52:11.884779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 165/314] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:11 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28175 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:11.901428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b7f04d45-48fd-4bd7-b3ed-7b728870b3e6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.123433 Jan 24 16:52:11.902244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 150/315] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:11 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:12.209777 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:12.210486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:12.217582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.218030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.218848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.219285 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.359505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:12.360269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:12.360411 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:12.367961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.368386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b1d4653e-9b09-4201-bb5f-bd6023c72d85 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.163180 Jan 24 16:52:12.368554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.368942 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 166/316] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:12 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:12.369476 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.369995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.478271 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:12.478915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:12.485668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.486120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.487109 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.487545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.517196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:12.532138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-34d5c308-0c8c-4998-83c4-7946dea6e0d9 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1526 microversion: 2.1 time: 0.176819 Jan 24 16:52:12.532752 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 151/317] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:12 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:12.630369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:12.637803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0353912c-2f35-474d-aa5d-f5399d5e478b tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1318 microversion: 2.1 time: 0.163804 Jan 24 16:52:12.638378 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 167/318] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:12 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:12.691817 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-92401f2c-4a34-4c91-8e8a-8fb54193d50f req-3e9a43a0-f6d8-4985-86ae-5a51feb8ffdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ca6098-0099-41ae-a01a-a19e52f1bc70", "name": "network-vif-plugged", "status": "completed", "tag": "1c00f2bb-a862-432a-8749-d007bd44785f"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:12.694161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:12.694161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:52:12.703118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-92401f2c-4a34-4c91-8e8a-8fb54193d50f req-3e9a43a0-f6d8-4985-86ae-5a51feb8ffdf service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.703773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-92401f2c-4a34-4c91-8e8a-8fb54193d50f req-3e9a43a0-f6d8-4985-86ae-5a51feb8ffdf service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.718091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-92401f2c-4a34-4c91-8e8a-8fb54193d50f req-3e9a43a0-f6d8-4985-86ae-5a51feb8ffdf service nova] Creating event network-vif-plugged:1c00f2bb-a862-432a-8749-d007bd44785f for instance b5ca6098-0099-41ae-a01a-a19e52f1bc70 on hv-cinder-82611 Jan 24 16:52:12.722909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-92401f2c-4a34-4c91-8e8a-8fb54193d50f req-3e9a43a0-f6d8-4985-86ae-5a51feb8ffdf service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035040 Jan 24 16:52:12.723701 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 152/319] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:12.896591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:12.897834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:12.904207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.904667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.906093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.906744 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.914466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:12.920582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:12.930666 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.931644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:12.932532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:12.932978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.414385 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cf39ca81-ecd6-476b-b31a-926d0895ecb6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28316 microversion: 2.1 time: 0.521765 Jan 24 16:52:13.415291 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 168/320] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:12 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:13.421119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:13.421825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:13.429045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.429503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.430304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.430949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.435127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-103f4ca9-5cf4-4ec0-abd7-ae2f2d67fc98 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.524986 Jan 24 16:52:13.441784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 153/321] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:12 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:13.551623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:13.552727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:13.563220 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.563673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.564747 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.565538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.584870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:13.595933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d938dee2-7f8b-4598-b980-7cd9ad7d77f5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.179336 Jan 24 16:52:13.596858 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 169/322] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:13 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:13.660555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:13.661422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:13.669860 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.670995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.671965 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.672467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.774478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:13.787825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b6f8e944-cb4f-4d91-83cf-0822cc3e6ae8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1506 microversion: 2.1 time: 0.241061 Jan 24 16:52:13.790106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 154/323] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:13 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:13.812409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:13.815054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:13.838007 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.838539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.839377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:13.840122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:13.917775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:13.930921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b989ec05-32d0-41dc-845b-52dbc1962206 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1502 microversion: 2.1 time: 0.277909 Jan 24 16:52:13.932551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 170/324] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:13 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1502 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:14.026027 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:14.041376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2e1c77e8-6a1f-4f75-9079-bf157d157fc8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1519 microversion: 2.1 time: 0.238924 Jan 24 16:52:14.054996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 155/325] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:13 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:14.429379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:14.430699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:14.441283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.442235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.444313 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.445094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.449127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:14.450978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:14.461067 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.461537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.463929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.467793 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.600651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-28075499-da72-4f2d-9b1d-4aae7a11949d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.155976 Jan 24 16:52:14.601385 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 156/326] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:14 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:14.613589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:14.614285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:14.621470 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.621995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.622795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:14.623239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:14.644845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1d2f3516-dab9-41a9-acdd-62588cd9df8e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28463 microversion: 2.1 time: 0.221045 Jan 24 16:52:14.647482 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 171/327] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:14 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:14.757878 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:14.765578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3ef9ad6b-37a4-4272-89c4-283a42ab9b08 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1322 microversion: 2.1 time: 0.156077 Jan 24 16:52:14.766148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 157/328] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:14 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:15.217133 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:15.217719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.225559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.226060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.226904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.227342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.253420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:52:15.338043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-84cf6b41-6e72-4711-89f8-98d91020f949 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "DELETE /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 204 len: 0 microversion: 2.1 time: 0.124650 Jan 24 16:52:15.339145 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 172/329] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:52:15 2022] DELETE /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:52:15.347302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:15.347977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.356249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.356702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.358018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.359329 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.498407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:15.506333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3ea80960-6c6b-45ac-8c8a-45083fc93fad tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1508 microversion: 2.1 time: 0.162991 Jan 24 16:52:15.506932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 158/330] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:15 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:15.612535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:15.613486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.623155 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.623727 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.624618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.624996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:15.625318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.625986 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.632627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.633280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.634059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.634493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.659567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lazy-loading 'flavor' on Instance uuid 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:52:15.751956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1bd87c7b-de2a-461b-80f9-fc46b2f216ff tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.143327 Jan 24 16:52:15.752640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 173/331] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:15 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:15.759550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:15.760787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.768143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ac47e377-d5c2-42c6-9db4-31a470c6abc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action" status: 200 len: 32 microversion: 2.1 time: 0.146828 Jan 24 16:52:15.768753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 159/332] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:15 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:52:15.773368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.773368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.773368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.773368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.778855 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:15.779635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.785659 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.786113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.787061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.787395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.895789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8b91d3ea-1dd9-4214-8393-83d75ad9a292 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28463 microversion: 2.1 time: 0.141375 Jan 24 16:52:15.897801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 174/333] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:15 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:15.903233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:15.904266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:15.912433 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.913213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.914235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:15.915235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:15.937829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:15.947642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e29f9016-f475-4172-af7a-310cfe817760 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.172601 Jan 24 16:52:15.948527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 160/334] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:15 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:16.232367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:16.239995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a31206ae-71e4-454f-84f3-919e2549cc42 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1513 microversion: 2.1 time: 0.340513 Jan 24 16:52:16.240332 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 175/335] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:15 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1513 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:16.524387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:16.525003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:16.531471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.532176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.533164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.533804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.686422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:16.694733 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b9b56724-99d8-433c-bed3-1e0321c49120 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1508 microversion: 2.1 time: 0.174716 Jan 24 16:52:16.695327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 161/336] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:16 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:16.764360 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:16.765318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:16.772457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.773033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.773854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.774289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.888941 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bdc88682-7b68-4f5c-b17b-ae52fece911d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.128398 Jan 24 16:52:16.889781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 176/337] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:16 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:16.907732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:16.908685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:16.914640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.915138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.915924 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.916381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.966519 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:16.967384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:16.974217 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.978904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:16.978904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:16.978904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.063165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1b6e5fbf-93a6-4453-9a83-4afd71236a8b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.158602 Jan 24 16:52:17.063810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 162/338] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:16 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:17.110531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:17.119157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5dd0f1d0-d800-46da-bda7-deb9c75bd20c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.157693 Jan 24 16:52:17.119712 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 177/339] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:16 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:17.565723 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de1f186d-87ec-4a9c-be4c-440c1b312f94"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:17.566902 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:17.574422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.574904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.575687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.576122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.711933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:17.712547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:17.723289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.723743 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.724543 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.725017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.837346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-80ea6393-6d1c-49fa-85e5-d5e89e47af19 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275753 Jan 24 16:52:17.837956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 163/340] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:17 2022] POST /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:17.880196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:17.889018 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-548c3643-f922-43bd-b7c1-60c2a6ccf2b2 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1508 microversion: 2.1 time: 0.180893 Jan 24 16:52:17.889582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 178/341] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:17 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:17.901833 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:17.902976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:17.909026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.909467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:17.910230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:17.910659 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.022419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f357c17e-862d-4e0f-b40c-866f9270f00c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 28906 microversion: 2.20 time: 0.125141 Jan 24 16:52:18.023334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 164/342] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:17 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 28906 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:18.074583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:18.075651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:18.085028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.085732 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.086537 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.087010 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.138955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:18.140025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:18.147411 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.148090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.148893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.149334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.185338 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-56de20d4-f3a6-4c15-ac72-edb272a40f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.114155 Jan 24 16:52:18.186091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 179/343] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:18 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:18.290392 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:18.297730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-59ef89a3-2b0a-46c1-bd7d-65a11615a4b0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.162825 Jan 24 16:52:18.298442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 165/344] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:18 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:18.908522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:18.910047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:18.920149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.920702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:18.921937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:18.922668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.034711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:19.035685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:19.043300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.043989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.044947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.045376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.160914 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:19.169402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4631d0ed-a643-45d5-bf3b-66b5e2f59525 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1508 microversion: 2.1 time: 0.267239 Jan 24 16:52:19.169970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 180/345] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:18 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:19.186717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f8891ffc-eab2-41fd-8f4a-e09e808229ba tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 29256 microversion: 2.20 time: 0.156689 Jan 24 16:52:19.191028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 166/346] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:19 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 29256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:19.197837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:19.198838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:19.206042 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.206513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.207319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.207770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.315961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6aaa255c-0879-4a2c-a946-a0b718b1af74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.121848 Jan 24 16:52:19.316195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:19.318180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:19.320638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 181/347] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:19 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:19.327134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.327888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.328916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.329445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.353753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-9356f14e-33c6-4903-a95d-5bee40f55f0b req-e66f6f6d-7b5c-449d-a522-f4bdbb3b31da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93bef71-7362-4652-86dd-a0ef15e0e727", "name": "network-vif-deleted", "tag": "089933b7-b1b4-46c7-ad20-aa745b6e9760"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:19.355731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:19.355731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:52:19.364153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9356f14e-33c6-4903-a95d-5bee40f55f0b req-e66f6f6d-7b5c-449d-a522-f4bdbb3b31da service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:19.364565 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9356f14e-33c6-4903-a95d-5bee40f55f0b req-e66f6f6d-7b5c-449d-a522-f4bdbb3b31da service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:19.376365 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-9356f14e-33c6-4903-a95d-5bee40f55f0b req-e66f6f6d-7b5c-449d-a522-f4bdbb3b31da service nova] Creating event network-vif-deleted:089933b7-b1b4-46c7-ad20-aa745b6e9760 for instance a93bef71-7362-4652-86dd-a0ef15e0e727 on hv-cinder-82611 Jan 24 16:52:19.381183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-9356f14e-33c6-4903-a95d-5bee40f55f0b req-e66f6f6d-7b5c-449d-a522-f4bdbb3b31da service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032773 Jan 24 16:52:19.382121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 182/348] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:19.513565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:19.521428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3e12caa1-78a9-4223-b0cc-5744c1d5e548 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.209727 Jan 24 16:52:19.522435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 167/349] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:19 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:20.187217 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:20.189136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:20.195645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.196316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.197400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.197980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.199375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:20.200412 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:20.207142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.207807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.208704 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.209780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.232834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.233348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.234071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lazy-loading 'fault' on Instance uuid a93bef71-7362-4652-86dd-a0ef15e0e727 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:52:20.275488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f058a8f1014fde9d4ec742e8174d00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5e86d82e0524fd380e44df98739cfa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:20.283250 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d5b784f4-bc45-4640-9a11-edd3e2c31a30 tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 200 len: 1308 microversion: 2.1 time: 0.100463 Jan 24 16:52:20.294532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 183/350] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:20 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:20.327901 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:20.328910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:20.337190 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.337986 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.339073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.339601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.342259 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d34d96fc-5b61-4153-be2d-c00430aefc60 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 29863 microversion: 2.20 time: 0.146597 Jan 24 16:52:20.342944 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 168/351] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:20 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 29863 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:20.427556 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1b31998c-f4f2-4d7e-8f5f-4a0137e55dfd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.103288 Jan 24 16:52:20.428981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 184/352] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:20 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:20.538775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:20.539498 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:20.546218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.546665 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.547464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:20.547896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:20.684784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:20.692789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cea3fa73-58b6-4571-ad0b-4df9ffadf524 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.158494 Jan 24 16:52:20.693424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 169/353] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:20 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:21.304272 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:21.306090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] [instance: a93bef71-7362-4652-86dd-a0ef15e0e727] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:21.318878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.318878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.318878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.318878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.336430 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] HTTP exception thrown: Instance a93bef71-7362-4652-86dd-a0ef15e0e727 could not be found. Jan 24 16:52:21.337143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] Returning 404 to user: Instance a93bef71-7362-4652-86dd-a0ef15e0e727 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:52:21.338051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9e7247a6-909d-4d8a-828d-c8d75d6744ec tempest-VolumesActionsTest-1878428310 tempest-VolumesActionsTest-1878428310-project] 10.222.0.117 "GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727" status: 404 len: 111 microversion: 2.1 time: 0.040003 Jan 24 16:52:21.338690 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 185/354] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:21 2022] GET /compute/v2.1/servers/a93bef71-7362-4652-86dd-a0ef15e0e727 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:52:21.355163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:21.356085 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:21.362116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.362907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.363977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.364887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.456819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:21.457879 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:21.468424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.468986 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.469881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.470428 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.527009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-80fa8277-b6cb-43b8-b651-7c4497c862f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 30888 microversion: 2.20 time: 0.175210 Jan 24 16:52:21.531582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 170/355] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:21 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 30888 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:21.595644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-53c9e3c7-da3f-4245-b8dc-c476742fcfda tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.157970 Jan 24 16:52:21.596980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 186/356] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:21 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:21.711940 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:21.713586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:21.722742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.723459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.725520 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:21.726457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:21.912934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:21.923713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-18c080ef-1f53-4c61-aa06-5fa8c4d79b2d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.214782 Jan 24 16:52:21.926967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 171/357] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:21 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:22.540971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:22.549865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:22.556782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.557293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:22.558080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.558643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:22.608232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:22.609343 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:22.616218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.616731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:22.617525 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.617963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:22.683149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e4d01ad1-61aa-43b7-86f2-fb5e6744f067 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 33742 microversion: 2.20 time: 0.147058 Jan 24 16:52:22.684800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 187/358] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:22 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 33742 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:22.717808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c99b2444-1890-4b82-a498-014d03f83e9d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.113131 Jan 24 16:52:22.718456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 172/359] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:22 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:22.945213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:22.945809 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:22.952707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.953150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:22.953919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:22.954348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.060522 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-579042985", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "2bfca7db-995d-4492-840e-71486008c43c"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:23.087778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:23.095240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8d588751-1915-4451-b110-6aa77c9aeafc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.154820 Jan 24 16:52:23.095872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 188/360] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:22 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:23.111687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] validate_networks() for [('2bfca7db-995d-4492-840e-71486008c43c', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:52:23.457459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:52:23.457886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:52:23.458364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:52:23.458816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:52:23.459241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:52:23.467675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.468127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.468945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.469387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.486179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Getting quotas for project 772de9e75506447b87526f3e1f2cf34f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:52:23.490709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Getting quotas for user 43bca89ee28143d780d350c37b3af65c and project 772de9e75506447b87526f3e1f2cf34f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:52:23.501257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:52:23.503627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:52:23.549667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c270bc99-c005-413d-b3a2-444f4e542ab4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.493094 Jan 24 16:52:23.550312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 173/361] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:52:23 2022] POST /compute/v2.1/servers => generated 382 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 16:52:23.560473 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6465c5a8-4dd8-4faf-922d-85a779ac1d2d tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:23.561087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6465c5a8-4dd8-4faf-922d-85a779ac1d2d tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:23.614124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6465c5a8-4dd8-4faf-922d-85a779ac1d2d tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:23.621485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6465c5a8-4dd8-4faf-922d-85a779ac1d2d tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1222 microversion: 2.1 time: 0.064755 Jan 24 16:52:23.622041 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 189/362] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:23 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:23.696176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:23.697255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:23.703608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.704068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.704955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.705442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.730098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:23.731093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:23.741826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.742823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:23.744220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:23.745382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:26.050177 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5b408e26-5ff7-471e-a424-480edab7e247 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 35244 microversion: 2.20 time: 2.359025 Jan 24 16:52:26.051063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 174/363] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:23 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 35244 bytes in 2361 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:26.056184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:26.056867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:26.061126 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2f7fb485-f5ee-4e94-9a5a-7bcd603b7022 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 2.334725 Jan 24 16:52:26.062521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 190/364] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:23 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:26.064236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:26.064694 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:26.065606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:26.066058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:26.067011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:26.067704 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:26.075189 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:26.075636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:26.076468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:26.076902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:26.148399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:26.164469 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b2a76f77-2240-41ff-8096-65632556c219 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1218 microversion: 2.1 time: 0.101242 Jan 24 16:52:26.165167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 191/365] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:26 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:26.213797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:26.221320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-49409839-bf96-4a1c-a55b-66900817d34a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.169122 Jan 24 16:52:26.221907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 175/366] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:26 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:27.061245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:27.062423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.070275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.070731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.071742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.072325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.074898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:27.076319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.084502 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.084980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.086353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.086731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.217037 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1d18cf1d-c665-4359-b539-8162a3ccd3e5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.146821 Jan 24 16:52:27.217656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 176/367] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:27 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:27.223171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:27.223881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.231021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.231484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.233896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.233896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.251667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-773d3020-01b4-40a8-a8f6-73192dc11883 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 35432 microversion: 2.20 time: 0.193234 Jan 24 16:52:27.252382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 192/368] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:27 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 35432 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:27.260396 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:27.261097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.268102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.268826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.269849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.270321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.334368 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:27.349315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-62cc9bb8-0bcc-48d0-a925-1f65b10de251 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1280 microversion: 2.1 time: 0.129730 Jan 24 16:52:27.349858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 177/369] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:27 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1280 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:27.443024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de1f186d-87ec-4a9c-be4c-440c1b312f94"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:27.444689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.451594 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.452091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.452926 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.453368 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.492861 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:27.500535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5dd91562-75b6-4a93-9858-ca1ffb96108f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.247081 Jan 24 16:52:27.501545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 193/370] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:27 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:27.534081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Invalid volume: volume de1f186d-87ec-4a9c-be4c-440c1b312f94 is already attached to instances: b5ca6098-0099-41ae-a01a-a19e52f1bc70 Jan 24 16:52:27.534685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 400 to user: Invalid volume: volume de1f186d-87ec-4a9c-be4c-440c1b312f94 is already attached to instances: b5ca6098-0099-41ae-a01a-a19e52f1bc70 {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:52:27.535553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e694092b-84fa-476b-a1fb-3d02af15cc9d tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096584 Jan 24 16:52:27.536135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 178/371] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:27 2022] POST /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 24 16:52:27.596830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:27.598079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.603962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.604352 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.605176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.605618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.736474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'services' on Instance uuid b5ca6098-0099-41ae-a01a-a19e52f1bc70 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:52:27.868025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c6f774fa-d55e-411a-aaa2-471c261763bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments/de1f186d-87ec-4a9c-be4c-440c1b312f94" status: 202 len: 0 microversion: 2.1 time: 0.274089 Jan 24 16:52:27.868770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 194/372] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:52:27 2022] DELETE /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments/de1f186d-87ec-4a9c-be4c-440c1b312f94 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:27.877402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:27.879510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:27.886982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.887441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.888355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:27.888948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:27.947684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-684899a4-76bf-408c-9212-db28f2b29573 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074117 Jan 24 16:52:27.953061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 179/373] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:27 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:28.230015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:28.246664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:28.257669 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.258210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.259278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.259966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.269617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:28.271063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:28.280257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.280993 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.282004 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.282405 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.379522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-43061b15-322b-43fc-8446-dd056150ffbb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.153170 Jan 24 16:52:28.383569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 195/374] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:28 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:28.385611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:28.386430 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:28.393423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.393875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.394863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.395480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.441607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-010702fc-2c51-43ac-9cbc-68b835b868b3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 35705 microversion: 2.20 time: 0.177833 Jan 24 16:52:28.442702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 180/375] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:28 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 35705 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:28.449010 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-004bb8cb-ce69-4143-9351-b30a8453cbfb req-1ce9354f-7123-4784-8aec-fe9e6293c3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb0d520-edd0-431c-983e-6560a5669811", "tag": "31d086bf-d040-4a43-b6d6-e919fbc05b71"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:28.454143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:28.454143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:52:28.464518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-004bb8cb-ce69-4143-9351-b30a8453cbfb req-1ce9354f-7123-4784-8aec-fe9e6293c3a0 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.465067 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-004bb8cb-ce69-4143-9351-b30a8453cbfb req-1ce9354f-7123-4784-8aec-fe9e6293c3a0 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.479040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-004bb8cb-ce69-4143-9351-b30a8453cbfb req-1ce9354f-7123-4784-8aec-fe9e6293c3a0 service nova] Creating event network-changed:31d086bf-d040-4a43-b6d6-e919fbc05b71 for instance 0eb0d520-edd0-431c-983e-6560a5669811 on hv-cinder-82611 Jan 24 16:52:28.484713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-004bb8cb-ce69-4143-9351-b30a8453cbfb req-1ce9354f-7123-4784-8aec-fe9e6293c3a0 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039534 Jan 24 16:52:28.485607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 181/376] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:28.522357 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:28.524087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:28.536656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.538286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.539891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.540942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.719531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:28.729976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ffdd307f-4d42-4f6c-8c35-097c309657ed tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.348134 Jan 24 16:52:28.730586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 196/377] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:28 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:28.809478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:28.818691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-31197a8c-e099-4674-8d9f-1c89fd9d0b5f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.302410 Jan 24 16:52:28.820196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 182/378] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:28 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:28.960328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:28.961830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:28.970383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.971270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:28.972390 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:28.973059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.004738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-27016db4-ca27-4674-b8dd-a600ed14ae49 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048826 Jan 24 16:52:29.009815 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 197/379] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:28 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:29.392612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:29.394215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:29.402026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.402935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.403980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.404623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.454183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:29.455522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:29.465159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.466498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.470084 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.470539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.540402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8371a219-35d9-4c93-8e16-6e6e21141b82 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.152693 Jan 24 16:52:29.541911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 183/380] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:29 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:29.608699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fe653de0-515f-4111-ad39-a6195e327062 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 36002 microversion: 2.20 time: 0.158649 Jan 24 16:52:29.609447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 198/381] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:29 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 36002 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:29.747255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:29.747950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:29.756931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.757315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.758192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.758686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.837470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:29.838188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:29.845745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.846463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.847339 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:29.848007 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:29.923315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:29.931989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dd9b2853-052f-45c1-96c9-f2c034d18f82 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.188102 Jan 24 16:52:29.932621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 184/382] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:29 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:30.002699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:30.011218 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-308a264a-54a8-4f31-aae5-b0acd9dc6f29 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.178469 Jan 24 16:52:30.020381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 199/383] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:29 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:30.038088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:30.039106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:30.045522 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.045988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.046777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.047661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.078401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-15111311-b29d-4b85-84a9-24bc0c2043a5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055852 Jan 24 16:52:30.078993 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 185/384] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:30 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:52:30.235723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-742447837", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "d2067982-5a38-46c1-8ec9-527550d6c2b1"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:30.300884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] validate_networks() for [('d2067982-5a38-46c1-8ec9-527550d6c2b1', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:52:30.552559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:30.554168 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:30.560493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.560942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.561757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.562449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.693242 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2d4608ad-410f-42be-9d58-920b8d2a7680 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.144128 Jan 24 16:52:30.697796 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 186/385] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:30 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:30.703955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:30.705290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:30.713762 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.714222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.715042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.715496 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.839732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dc767672-856a-4e8b-9394-6fe0174234be tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 36390 microversion: 2.20 time: 0.140144 Jan 24 16:52:30.841586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 187/386] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:30 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 36390 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:30.912404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:52:30.912930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:52:30.913273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:52:30.913682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:52:30.914092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:52:30.924119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.924588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.925547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.926121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.954259 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:30.955628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:30.971338 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:52:30.977558 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Getting quotas for user feb8ddf0abd84c1caed8501c57b56f20 and project 23f1bf5dafe744d48d952fbe6209dd79. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:52:30.991126 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:30.996123 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:30.998618 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.000842 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.004251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:52:31.008267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:52:31.075421 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5e5dcd50-6b10-470b-b78d-93f8b90234c8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.843353 Jan 24 16:52:31.076338 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 200/387] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:52:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:52:31.094853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:31.100344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:31.119002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.119824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.120829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.121431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.219412 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:31.231153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cc5dce69-17a7-4010-9081-62f927fca8c5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.283505 Jan 24 16:52:31.232279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 188/388] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:30 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:31.236884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5b850cfd-dca4-4a18-8108-e210e0eee2e5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:31.237506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5b850cfd-dca4-4a18-8108-e210e0eee2e5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:31.317100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5b850cfd-dca4-4a18-8108-e210e0eee2e5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:31.327977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5b850cfd-dca4-4a18-8108-e210e0eee2e5 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1221 microversion: 2.1 time: 0.094541 Jan 24 16:52:31.328921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 189/389] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:31 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:31.369609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:31.378572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-823c0893-ef08-4a08-bf4e-daeb63781589 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.290913 Jan 24 16:52:31.379318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 201/390] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:31 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:31.726054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:31.728414 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:31.742227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.746077 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.747351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.748406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.847443 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-09786862-55b5-446d-9770-6dce5c7be22b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28631 microversion: 2.1 time: 0.134046 Jan 24 16:52:31.851845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 190/391] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:31 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28631 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:31.856912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:31.858186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:31.864408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.872205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:31.873333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:31.877070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.044288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f9a833e1-fb1f-440c-a5f3-8a3d5377ea68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 37021 microversion: 2.20 time: 0.190977 Jan 24 16:52:32.045396 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 202/392] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:31 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 37021 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:32.251953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:32.252684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:32.270220 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.271343 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.272874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.273993 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.347495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:32.348485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:32.356706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.362973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.364093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.364927 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.450835 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:32.466063 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-57b61a5a-c5c0-44ed-a3f5-7a4a3989c1d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1273 microversion: 2.1 time: 0.122706 Jan 24 16:52:32.467043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 203/393] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:32 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:32.476660 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:32.477304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:32.486852 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.487306 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.488116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.488552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.534782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:32.551141 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1db8b35c-de03-4e99-a127-f486f57c597f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.306620 Jan 24 16:52:32.553270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 191/394] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:32 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:32.704500 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:32.715616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0eee7deb-003a-49a3-b357-8382f37ea573 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.247248 Jan 24 16:52:32.731222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 204/395] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:32 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:32.860104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:32.862148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:32.878132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.878598 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:32.879468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:32.879945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.058712 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:33.059736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:33.080323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.080784 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.081601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.082043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.141945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1446eb57-dddd-4f56-aa9b-68f371a7fd1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 28922 microversion: 2.1 time: 0.285343 Jan 24 16:52:33.146314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 192/396] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:32 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 28922 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:33.277632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-038aa740-1d91-4898-b081-9a3c609ac52d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 37525 microversion: 2.20 time: 0.223117 Jan 24 16:52:33.278181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 205/397] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:33 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 37525 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:33.484250 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:33.484981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:33.502985 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.514944 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.516157 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.517040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.569591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:33.570640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:33.577924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.578700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.579829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.580484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.773997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:33.782471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d78dc23d-4c96-4772-9ea5-c0b2fabb3727 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.302480 Jan 24 16:52:33.792698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 193/398] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:33 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:33.792698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:33.793620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:33.803069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.804171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.805566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:33.806491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:33.886577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:33.902236 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fb25f126-0ee0-49dc-89a1-273523afb6e2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.336764 Jan 24 16:52:33.903477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 206/399] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:33 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:34.008722 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:34.016348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2cfeabc2-1c52-40e7-98f4-ce5c9aeb1b6a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.231747 Jan 24 16:52:34.018355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 194/400] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:33 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:34.153375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:34.154220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:34.162093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.162555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.163391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.163823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.280719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cb390191-27e0-47a1-bfcf-d4a7aad02bec tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 29669 microversion: 2.1 time: 0.130730 Jan 24 16:52:34.282040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 207/401] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:34 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 29669 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:34.293191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:34.297458 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:34.313274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.314156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.315225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.315862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.461316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1bcadfe9-e2f9-4dbb-9065-d8fb07b0a392 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 37902 microversion: 2.20 time: 0.173389 Jan 24 16:52:34.462789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 195/402] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:34 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 37902 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:34.513086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-6010eb7f-1385-422f-9c8a-0b478a229e1e req-cef9bfeb-aab5-4a8e-a8fd-f582851485f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d06636-896c-41fe-bbbb-6828092fd5e7", "tag": "4c6ddf50-33be-4ddf-8e85-0eb97f669b8d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:34.515452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:34.515452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:52:34.543258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-6010eb7f-1385-422f-9c8a-0b478a229e1e req-cef9bfeb-aab5-4a8e-a8fd-f582851485f0 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.543707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-6010eb7f-1385-422f-9c8a-0b478a229e1e req-cef9bfeb-aab5-4a8e-a8fd-f582851485f0 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.560538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-6010eb7f-1385-422f-9c8a-0b478a229e1e req-cef9bfeb-aab5-4a8e-a8fd-f582851485f0 service nova] Creating event network-changed:4c6ddf50-33be-4ddf-8e85-0eb97f669b8d for instance d6d06636-896c-41fe-bbbb-6828092fd5e7 on hv-cinder-82611 Jan 24 16:52:34.566242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-6010eb7f-1385-422f-9c8a-0b478a229e1e req-cef9bfeb-aab5-4a8e-a8fd-f582851485f0 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057350 Jan 24 16:52:34.567322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 208/403] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:34.800677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:34.801377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:34.809982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.810436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.811262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.811959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.920277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:34.921380 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:34.936981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.947580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.948829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:34.949497 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:34.957228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:34.967416 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f2d30b6c-a706-47bc-95c7-4fe5e290ff8a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.170662 Jan 24 16:52:34.968276 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 196/404] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:34 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:35.035640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:35.037872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:35.045087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.045702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.046730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.047269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.233420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:35.246854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9a9c80d4-ebe5-4c77-91f9-c6250d2b6463 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.330857 Jan 24 16:52:35.247211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:35.247668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 209/405] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:34 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:35.267818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4449b2ca-e71a-4598-84d7-ba7cf6ea441f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.235965 Jan 24 16:52:35.268816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 197/406] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:35 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:35.293806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:35.294736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:35.302945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.303714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.304520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.304954 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.473268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:35.475365 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:35.481769 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.482320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.483261 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.483843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.491717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c6eddc9b-981a-4c8d-aea4-29dd05063806 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 30343 microversion: 2.1 time: 0.201773 Jan 24 16:52:35.492945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 210/407] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:35 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 30343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:35.635440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e56279a7-406a-4471-8230-b5d024a32b21 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 38218 microversion: 2.20 time: 0.165739 Jan 24 16:52:35.636797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 198/408] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:35 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 38218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:35.986930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:35.987791 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:35.995675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.996131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:35.997109 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:35.997687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.184607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:36.193998 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5f0149cf-5e0c-482e-9fd3-02a12841e50b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.211977 Jan 24 16:52:36.194715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 211/409] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:35 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:36.264794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:36.266106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:36.273547 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.274195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.275030 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.275454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.284583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:36.285425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:36.292215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.292742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.293534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.294100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.456434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:36.466280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:36.469407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8d709a2d-f606-478c-97c5-fa596c79250e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.208492 Jan 24 16:52:36.470160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 199/410] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:36 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:36.476494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-189ccc6a-98fc-46b5-963c-c48b8514f5b8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.195278 Jan 24 16:52:36.478071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 212/411] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:36 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:36.503858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:36.504876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:36.511384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.511832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.512633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.513066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.641107 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c36f2e8c-2171-4bc9-97d8-936d5645d31d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 30812 microversion: 2.1 time: 0.136114 Jan 24 16:52:36.641288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 200/412] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:36 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 30812 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:36.648359 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:36.649331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:36.655468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.655924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.656708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.657147 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:36.774370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9d94753e-c5b3-4de2-8ab8-7f552bdf2b59 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 38349 microversion: 2.20 time: 0.129496 Jan 24 16:52:36.775903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 213/413] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:36 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 38349 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:36.983478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-a35179c3-0765-440e-84e9-31d25c59efa3 req-ad8fc679-4783-4202-93e3-26ecd391d1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb0d520-edd0-431c-983e-6560a5669811", "name": "network-vif-plugged", "status": "completed", "tag": "31d086bf-d040-4a43-b6d6-e919fbc05b71"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:36.984979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:36.984979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:52:36.994871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-a35179c3-0765-440e-84e9-31d25c59efa3 req-ad8fc679-4783-4202-93e3-26ecd391d1c8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:36.995651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-a35179c3-0765-440e-84e9-31d25c59efa3 req-ad8fc679-4783-4202-93e3-26ecd391d1c8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.011698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-a35179c3-0765-440e-84e9-31d25c59efa3 req-ad8fc679-4783-4202-93e3-26ecd391d1c8 service nova] Creating event network-vif-plugged:31d086bf-d040-4a43-b6d6-e919fbc05b71 for instance 0eb0d520-edd0-431c-983e-6560a5669811 on hv-cinder-82611 Jan 24 16:52:37.016785 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-a35179c3-0765-440e-84e9-31d25c59efa3 req-ad8fc679-4783-4202-93e3-26ecd391d1c8 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037326 Jan 24 16:52:37.018478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 201/414] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:37.213280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:37.214187 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:37.222301 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.222909 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.224090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.224619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.409760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:37.418295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6766a192-0435-4679-9bed-b0372cc64307 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.210818 Jan 24 16:52:37.418874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 214/415] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:37 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:37.489851 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:37.491660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:37.495789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:37.496408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:37.499058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.499603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.500653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.501184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.504130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.504541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.507559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.508118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.670857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:37.679600 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2d7ee079-efa9-400a-863c-9a11ef95e890 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.187412 Jan 24 16:52:37.689207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 215/416] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:37 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:37.689207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:37.689207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:37.693550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.694051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.695038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.695479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.705453 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:37.719662 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e3994ef5-1440-4239-b91e-7dc506b76311 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.234473 Jan 24 16:52:37.721035 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 202/417] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:37 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:37.788304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:37.789639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:37.798267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.799015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.800615 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:37.801240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:37.819984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-eb4aaf8f-4d62-4a97-940c-1d3780e35556 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 31417 microversion: 2.1 time: 0.138091 Jan 24 16:52:37.820924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 216/418] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:37 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 31417 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:37.916741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cc97c4a4-1636-48f0-b2c2-67b9176ff80d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 38349 microversion: 2.20 time: 0.134701 Jan 24 16:52:37.917492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 203/419] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:37 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 38349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:38.435289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:38.436911 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:38.443874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.444322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.445101 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.445531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.593494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:38.602331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ec24f9c9-abc8-47d4-a2c1-ec0c9f98661f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.170885 Jan 24 16:52:38.603353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 217/420] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:38 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:38.697433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:38.698320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:38.705753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.706427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.707381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.708701 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.737734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:38.738335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:38.745270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.745724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.746512 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.747114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.857797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:38.866781 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b53734e7-fa69-4805-80d6-25d58a185d83 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.173334 Jan 24 16:52:38.876068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 204/421] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:38 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:38.880907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:38.881769 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:38.888117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.888630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.889361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.889798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.934849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:38.943576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-513aee31-5a27-493c-809f-b20c7e618074 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1322 microversion: 2.1 time: 0.209467 Jan 24 16:52:38.955037 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 218/422] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:38 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:38.962252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:38.963367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:38.972018 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.972467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.973913 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:38.974361 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:38.997455 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7d0d91ef-60e9-4961-9c7e-08d21f81ed81 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 31752 microversion: 2.1 time: 0.120054 Jan 24 16:52:38.998691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 205/423] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:38 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 31752 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:39.162646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5e1a8c1e-c15c-42d6-ba7f-4a8b9ba3f91f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 38354 microversion: 2.20 time: 0.206025 Jan 24 16:52:39.163347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 219/424] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:38 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 38354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:39.620120 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:39.620818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:39.627914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.628980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:39.630352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.630831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:39.807307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:39.826236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-09f0305d-f851-4cbe-9867-89285eb95e4b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.209949 Jan 24 16:52:39.826957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 206/425] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:39 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:39.884738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:39.885885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:39.893456 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.893910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:39.894706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.896239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:39.980160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:39.980779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:39.987671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.988124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:39.990021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:39.990458 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.085721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:40.093792 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f6d27a1c-3362-4ff2-9119-dca07344b461 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.213928 Jan 24 16:52:40.094385 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 220/426] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:39 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:40.109866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:40.110839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:40.118729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.119352 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.120159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.120480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.159445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:40.167415 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a47f68f2-c701-45ef-a8c0-809d32e9c21c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1510 microversion: 2.1 time: 0.190783 Jan 24 16:52:40.179164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 207/427] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:39 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:40.179164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:40.179164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:40.186137 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.186888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.188410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.188864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.246305 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e63f0a56-692a-4d86-8c45-1e57ec746f26 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 32121 microversion: 2.1 time: 0.141044 Jan 24 16:52:40.250158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 221/428] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:40 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 32121 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:40.339351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fa4e9e5f-b629-4403-ae33-7bcd7a7abee5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 200 len: 38489 microversion: 2.20 time: 0.168071 Jan 24 16:52:40.340688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 208/429] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:40 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 38489 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:40.352234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:40.352825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:40.359826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.360285 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.361079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.361518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.406363 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8c2e263c-903f-40c0-a529-ea00089b7926 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/ips" status: 200 len: 152 microversion: 2.20 time: 0.058968 Jan 24 16:52:40.406983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 222/430] 10.222.0.117 () {60 vars in 1293 bytes} [Mon Jan 24 16:52:40 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:40.846679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:40.847381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:40.863532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.864864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:40.865837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:40.868411 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.029444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:41.037537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ab9c920d-e0ac-4834-955b-c929bbe49d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.195525 Jan 24 16:52:41.038103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 209/431] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:40 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:41.111306 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:41.111922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:41.119819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:41.120305 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.121129 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:41.121601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.257464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:41.257864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:41.258547 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:41.264728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:41.265190 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.265285 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7daae8b3-78d6-448c-b8e2-a53167c6fe77 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.157712 Jan 24 16:52:41.265773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 223/432] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:41 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:41.265978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:41.266416 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.391180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f1830954-b8e1-4682-b365-a41f85a83a1a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 32518 microversion: 2.1 time: 0.137182 Jan 24 16:52:41.391804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 210/433] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:41 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 32518 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:41.867484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-4f3cfcb6-7b88-451f-af8a-6115974612c2 req-d5125f08-d165-45bf-a5e8-072601a7b802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d06636-896c-41fe-bbbb-6828092fd5e7", "name": "network-vif-plugged", "status": "completed", "tag": "4c6ddf50-33be-4ddf-8e85-0eb97f669b8d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:41.871399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:52:41.871399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:52:41.883824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-4f3cfcb6-7b88-451f-af8a-6115974612c2 req-d5125f08-d165-45bf-a5e8-072601a7b802 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:41.884898 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-4f3cfcb6-7b88-451f-af8a-6115974612c2 req-d5125f08-d165-45bf-a5e8-072601a7b802 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:41.904871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-4f3cfcb6-7b88-451f-af8a-6115974612c2 req-d5125f08-d165-45bf-a5e8-072601a7b802 service nova] Creating event network-vif-plugged:4c6ddf50-33be-4ddf-8e85-0eb97f669b8d for instance d6d06636-896c-41fe-bbbb-6828092fd5e7 on hv-cinder-82611 Jan 24 16:52:41.913495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-4f3cfcb6-7b88-451f-af8a-6115974612c2 req-d5125f08-d165-45bf-a5e8-072601a7b802 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056709 Jan 24 16:52:41.914734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 224/434] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:42.056260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:42.057011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.077721 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.078253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.079298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.079955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.241336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:42.248820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e89ddb8a-e33c-4a4c-b033-6e2a80abc9ee tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.198142 Jan 24 16:52:42.249377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 211/435] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:42 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:42.284545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:42.285240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.292093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.292539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.293327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.293764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.403318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:42.404257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.415116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.415875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.416859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.417988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.453295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:42.461452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b44c0a3b-87f0-413f-bdbf-d851f318926b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1505 microversion: 2.1 time: 0.181601 Jan 24 16:52:42.462020 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 225/436] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:42 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:42.478842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b062f9f-032a-46a0-b4d5-21f952e4067d"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:42.480007 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.485955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.486403 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.487429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.488059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.512829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] HTTP exception thrown: Cannot 'attach_volume' instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 while it is in vm_state rescued Jan 24 16:52:42.513443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Returning 409 to user: Cannot 'attach_volume' instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 while it is in vm_state rescued {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:52:42.514289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-78915753-d567-4d5d-964a-87ee1f26f486 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039082 Jan 24 16:52:42.517976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 226/437] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:42 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jan 24 16:52:42.523437 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:42.524005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.530050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.530505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.531332 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.532009 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.533666 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9307a7eb-e1db-4f9c-b3f1-28ddba833985 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 32914 microversion: 2.1 time: 0.133844 Jan 24 16:52:42.534496 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 212/438] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:42 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 32914 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:42.606113 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c87e21be-4b83-4006-8ab8-cac2a4fd3a1a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action" status: 202 len: 0 microversion: 2.1 time: 0.086246 Jan 24 16:52:42.607031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 227/439] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:42 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:52:42.617048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:42.617754 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:42.626965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.627417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.628678 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:42.629222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:42.778526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:42.788971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9e31bb9b-c3d8-4adb-82f4-3ca6b3907407 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1513 microversion: 2.1 time: 0.177315 Jan 24 16:52:42.794795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 213/440] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:42 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:43.170554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:43.171122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:43.178637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.179331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.180199 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.180766 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.226150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lazy-loading 'flavor' on Instance uuid fb3e6d05-f352-44f0-88b9-77cf52d979a3 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:52:43.268832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:43.270627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:43.284478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.285013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.287081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.287710 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.443706 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:43.455098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-94bf6838-e07c-4c72-bd89-4f34dabf4704 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1321 microversion: 2.1 time: 0.192052 Jan 24 16:52:43.455705 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 214/441] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:43 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:43.545393 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:43.546681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:43.554193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.554715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.555721 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.556268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.685592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8dc313b0-4f78-4ccd-a6ed-abafd8049651 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 33271 microversion: 2.1 time: 0.143736 Jan 24 16:52:43.686490 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 215/442] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:43 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 33271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:43.807557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:43.808173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:43.815085 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.815591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.816304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:43.816743 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:43.980326 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:43.987565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5ffd7cdd-0fba-41f3-8870-cbc636795d3b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1513 microversion: 2.1 time: 0.184053 Jan 24 16:52:43.988124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 216/443] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:43 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:44.471769 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:44.472398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:44.479503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:44.479950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:44.481003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:44.481445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:44.620851 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:44.628300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e8d73b3e-330e-4e79-9438-3bab3566725c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1511 microversion: 2.1 time: 0.160231 Jan 24 16:52:44.629402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 217/444] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:44 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:44.698490 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:44.699512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:44.717413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:44.718324 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:44.727834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:44.734426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:44.890570 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8e19a3fd-a7f5-4fe3-ba8f-532e2a72865f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 34320 microversion: 2.1 time: 0.194910 Jan 24 16:52:44.898281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 218/445] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:44 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 34320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:45.007424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:45.008249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:45.018606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:45.019245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:45.020247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:45.021569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:45.168527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:45.175790 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9f54eef8-58ff-4554-abfb-712c38e9869e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1513 microversion: 2.1 time: 0.172820 Jan 24 16:52:45.176358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 219/446] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:45 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:45.904041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:45.905085 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:45.913454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:45.913935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:45.914832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:45.915278 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:46.041894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d7c85e27-1314-46e5-a124-2c21d7f85017 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 34777 microversion: 2.1 time: 0.141891 Jan 24 16:52:46.042843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 220/447] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:45 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 34777 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:46.092904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d59a8d6e-35fd-4669-8a3a-e97e794c6520"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:46.094322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:46.101887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:46.102336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:46.103149 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:46.103584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:46.384071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-38d8123e-8fe1-4391-95db-6861417541be tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "POST /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295156 Jan 24 16:52:46.389283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 221/448] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:46 2022] POST /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:46.389838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:46.390565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:46.410112 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:46.410563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:46.411649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:46.411994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:46.569112 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:46.578845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f3d46760-143b-42b8-b3d0-d310e024a262 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1513 microversion: 2.1 time: 0.192930 Jan 24 16:52:46.579417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 222/449] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:46 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:52:47.054556 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:47.055699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:47.062113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:47.062587 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:47.063407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:47.063931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:47.174413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-61f270cb-ce95-4246-8850-1ad8c6e82aa1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 35213 microversion: 2.1 time: 0.123963 Jan 24 16:52:47.175543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 223/450] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:47 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 35213 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:47.597268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:47.598095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:47.605196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:47.605821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:47.606616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:47.607090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:47.749045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:47.761386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-02bac25b-a238-4ae5-bd9c-3325924a0b7f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1519 microversion: 2.1 time: 0.168003 Jan 24 16:52:47.772444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 224/451] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:47 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:48.185611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:48.186829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:48.193270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:48.193833 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:48.194641 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:48.195094 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:48.291340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6f71585e-7829-453f-aeef-a76e621d172d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 35790 microversion: 2.1 time: 0.109120 Jan 24 16:52:48.291981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 225/452] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:48 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 35790 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:49.101438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:49.102136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:49.108765 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.109218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.110031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.110466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.266321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:49.276798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a74d9247-dc16-4a58-84f0-a7962ccf8882 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1519 microversion: 2.1 time: 0.179464 Jan 24 16:52:49.277661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 226/453] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:52:49 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:52:49.292822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96209495-92fa-4bc2-9a4e-327031b2c78b"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:49.293872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:49.299832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.300285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.301068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.301508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.567075 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c70308f5-bf93-4a3c-b6b6-dda3c42e9291 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277737 Jan 24 16:52:49.567822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 227/454] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:49 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:49.578684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:49.579520 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:49.588317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.588692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.589613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:49.590053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:49.719683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3d3519c-a8c1-4976-b707-fc3bb5227852 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 36780 microversion: 2.1 time: 0.145438 Jan 24 16:52:49.720445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 228/455] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:49 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 36780 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:50.733415 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:50.734421 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:50.742211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:50.743207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:50.743999 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:50.744434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:50.853731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-077719df-87c9-4a1d-a47b-a66b9760790c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 37633 microversion: 2.1 time: 0.123982 Jan 24 16:52:50.854242 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 229/456] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:50 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 37633 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:51.869515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:51.871532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:51.880513 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:51.881361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:51.882191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:51.882788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:51.997698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-987dbaf6-e645-41fd-88e6-bc7c5b9ff69b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 38084 microversion: 2.1 time: 0.133379 Jan 24 16:52:51.998663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 230/457] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:51 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 38084 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:53.010839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:53.012612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:53.019510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:53.019894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:53.020685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:53.021231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:53.172788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2e4d7534-c94d-4f71-8623-40e03a41b1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 38112 microversion: 2.1 time: 0.166308 Jan 24 16:52:53.173434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 231/458] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:53 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 38112 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:54.082600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:54.083255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:54.090937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.091385 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.092163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.092596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.177178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'services' on Instance uuid d6d06636-896c-41fe-bbbb-6828092fd5e7 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:52:54.253272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-06290e7f-a074-4509-9ac1-565df11e0260 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments/d59a8d6e-35fd-4669-8a3a-e97e794c6520" status: 202 len: 0 microversion: 2.1 time: 0.174361 Jan 24 16:52:54.254133 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 232/459] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:52:54 2022] DELETE /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments/d59a8d6e-35fd-4669-8a3a-e97e794c6520 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:52:54.260184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:54.261189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:54.267429 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.267918 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.268713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.269233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.399718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fb114adf-9ff2-4df4-a31f-93edfd8f044e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 38132 microversion: 2.1 time: 0.144046 Jan 24 16:52:54.400354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 233/460] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:54 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 38132 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:52:54.405415 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:54.406402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:54.413447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.415153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.415153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:54.415368 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:54.451630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-68510095-4577-4ebb-a652-8cf1243be1bd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 Jan 24 16:52:54.452607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 234/461] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:54 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:55.412013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:55.412841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:55.421188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.421640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.422613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.423091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.515983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8848413a-d8f7-4f41-896f-6a7615656743 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 200 len: 38243 microversion: 2.1 time: 0.107865 Jan 24 16:52:55.517441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 235/462] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:52:55 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 38243 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:52:55.522103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:55.523332 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:55.531413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.531866 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.532670 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.533109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.567601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6558b094-e77c-471a-a052-d36b15d976ca tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049676 Jan 24 16:52:55.568185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 236/463] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:55 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:55.574581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:55.575188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:55.589013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.589469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.590268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.590717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.615482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0b2235ca-3b5a-4b2c-afbc-c27167df1a54 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/ips" status: 200 len: 147 microversion: 2.1 time: 0.045589 Jan 24 16:52:55.616051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 237/464] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:52:55 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:55.899954 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ca3f4197-9c2d-480c-9b68-f9c4d7b568cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 202 len: 0 microversion: 2.20 time: 12.734245 Jan 24 16:52:55.900568 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 228/465] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:52:43 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 0 bytes in 12736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:52:55.908345 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:55.908945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:55.915967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.916413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:55.917201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:55.917634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:56.050002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:56.059318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:56.061089 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:56.062291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d5977b71-8704-4086-bc27-d824ac48de86 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.157579 Jan 24 16:52:56.062864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 238/466] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:52:55 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:52:56.581985 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:56.583078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:56.589354 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:56.589795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:56.590564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:56.591029 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:56.619492 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-84bfe78b-f9cb-4c59-a044-89575a11159e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042076 Jan 24 16:52:56.620035 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 229/467] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:56 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:57.081283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:57.082021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:57.089093 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:57.089542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:57.090332 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:57.090795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:57.240482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:57.249267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:57.250784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:57.251932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-eda05840-bbc6-4eb3-ab2b-301a6f502a1c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.174356 Jan 24 16:52:57.260865 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 239/468] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:52:57 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:52:57.635557 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:57.637329 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:57.648715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:57.649514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:57.650951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:57.651753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:57.696698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-716718eb-7939-47b0-bfdb-bdc6988b781c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069147 Jan 24 16:52:57.697333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 230/469] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:57 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:58.270441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:58.271185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:58.279056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.279541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.280286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.280715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.410928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:58.418802 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:58.420337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:58.421537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-779dfc95-3044-436a-b6a4-bacb25b2d51e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.154873 Jan 24 16:52:58.422104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 240/470] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:52:58 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:52:58.707239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:58.708221 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:58.718960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.718960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.718960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.718960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.728058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e939ecc8-9434-48e4-b6b0-1cb0ecbf1521"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:52:58.740631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:58.748279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.748745 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.749547 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:58.749992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:58.768776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-56267905-191a-4c11-843a-302efde04673 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065382 Jan 24 16:52:58.769334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 231/471] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:58 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:52:59.000740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6748508c-819b-4e8c-aa5d-45c701d82fa9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277585 Jan 24 16:52:59.001396 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 241/472] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:52:58 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:52:59.451133 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:59.451801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:59.458834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:59.459608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:59.460506 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:59.461548 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:59.603429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:59.611366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:59.612877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:52:59.614031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e78cfda8-8cea-4041-b3ae-19cf8312c224 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.176035 Jan 24 16:52:59.614588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 232/473] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:52:59 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:52:59.781213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:52:59.782225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:52:59.789022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:59.789558 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:59.790345 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:52:59.790800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:52:59.824298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9e19d519-99ca-41fa-936b-7f1edb756520 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Jan 24 16:52:59.824976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 242/474] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:52:59 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:00.632063 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:00.633308 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:00.639597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:00.640040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:00.640805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:00.641232 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:00.772559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:00.780735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:00.782588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:00.783879 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ecb50985-dfb3-4d44-9b04-de38160b7bcd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.155486 Jan 24 16:53:00.784503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 233/475] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:00 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:00.835262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:00.836826 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:00.843273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:00.843727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:00.844628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:00.845069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:00.875130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-384a7c4b-669d-4f17-a039-a95d8af3bf2e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Jan 24 16:53:00.875819 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 243/476] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:00 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:01.319350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:01.321528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:01.327389 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.327839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.328619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.329055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.351189 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lazy-loading 'flavor' on Instance uuid 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:01.467724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-48fc4730-87df-4517-868c-815e634f53ee tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action" status: 200 len: 32 microversion: 2.1 time: 0.152109 Jan 24 16:53:01.468335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 234/477] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:53:01 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action => generated 32 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:53:01.477611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:01.478225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:01.484594 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.485047 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.485888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.486845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.629170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:01.637460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-feaf8b37-3141-44fb-bbc9-d7ac4efb597a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.164091 Jan 24 16:53:01.638039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 244/478] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:01 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:01.803721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:01.805168 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:01.811417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.811862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.812634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.813069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.886681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:01.887605 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:01.893434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.893886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.894682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:01.895248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:01.925132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4087ed7f-80b2-417a-9e41-6017d5870e99 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042257 Jan 24 16:53:01.925702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 245/479] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:01 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:02.015764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:02.024465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:02.025993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:02.027242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b904594c-c6c7-4b12-9f35-ad7b621bdc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.227940 Jan 24 16:53:02.027803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 235/480] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:01 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:02.655009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:02.655619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:02.661809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:02.662264 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:02.663081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:02.663578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:02.796946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:02.805054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d64968b7-332d-4eea-92ad-a0e440e7676b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.153964 Jan 24 16:53:02.805834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 246/481] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:02 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:02.936613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:02.937541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:02.945514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:02.946088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:02.947128 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:02.947642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:02.980601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dd20acc5-8ebe-4832-b791-c28f16416a4c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048021 Jan 24 16:53:02.981087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 236/482] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:02 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:53:03.047817 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:03.048828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:03.054689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:03.055585 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:03.056510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:03.057223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:03.199106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:03.207043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:03.208732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:03.209960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-85f656ac-064a-4e43-9c8b-49469ca750f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.167686 Jan 24 16:53:03.211475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 247/483] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:03 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:03.823000 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:03.823853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:03.838947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:03.839603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:03.840653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:03.841784 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:03.996955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:04.005680 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b7036ca4-4ad6-4c6d-be17-b849c528f980 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.186862 Jan 24 16:53:04.006357 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 237/484] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:03 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:04.187294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:04.187792 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:04.194594 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.195122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.195994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.196454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.224226 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:53:04.230813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:04.231697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:04.237885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.238571 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.239454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.240095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.326673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-34b13c18-3178-4aff-a0e5-040b44b2c81e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 204 len: 0 microversion: 2.1 time: 0.144124 Jan 24 16:53:04.327702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 248/485] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:53:04 2022] DELETE /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:53:04.339450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:04.340382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:04.347288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.348122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.349053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:04.349697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:04.406586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:04.415759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:04.417321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:04.418477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c1dc2851-ec1c-466e-898b-b053d183c2a7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.192953 Jan 24 16:53:04.426905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 238/486] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:04 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:04.590841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:04.599402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e1cf5d5f-75cd-4364-862d-c5d31869ab67 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1517 microversion: 2.1 time: 0.266040 Jan 24 16:53:04.599973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 249/487] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:04 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1517 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:05.024048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:05.024642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:05.030610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.031092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.031897 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.032337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.177286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:05.189547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-57535089-2bc2-4d51-913b-485813abb7e2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.170312 Jan 24 16:53:05.190206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 239/488] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:05 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:05.436801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:05.437401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:05.443985 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.444435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.445868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.446478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.615710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:05.617646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:05.623795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.624254 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.625195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:05.625637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:05.716943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:05.733627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:05.735062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:05.736717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e4d39454-1417-4dd4-9bfd-922d60665e52 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.303849 Jan 24 16:53:05.737508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 250/489] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:05 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:05.810796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:05.818984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e15420b5-9b21-4693-a566-4fa7a3976750 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1517 microversion: 2.1 time: 0.207036 Jan 24 16:53:05.819723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 240/490] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:05 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:06.214283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:06.215312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:06.222639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.223473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:06.224483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.224926 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:06.524169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:06.532216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-500bb151-7df2-4e3d-a7cd-9c83880bd6df tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.326312 Jan 24 16:53:06.532780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 251/491] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:06 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:06.759944 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:06.761398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:06.768707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.769459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:06.770496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.771414 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:06.839435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:06.840964 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:06.850132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.851871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:06.853227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:06.853805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:07.068758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:07.069919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:07.078089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:07.082426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-35cf3575-4669-4c4c-ad8a-7910abdbaae8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1517 microversion: 2.1 time: 0.248262 Jan 24 16:53:07.083138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 252/492] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:06 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1517 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:07.084561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:07.096892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ed7a3bdf-ab42-44ec-9a4b-d14491a621e2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.340781 Jan 24 16:53:07.099539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 241/493] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:06 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:07.549266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:07.549909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:07.556806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:07.557430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:07.558217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:07.558909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:07.702863 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:07.712090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dd169e97-4525-479a-81ac-12346d151527 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.166318 Jan 24 16:53:07.713473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 253/494] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:07 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:08.106222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:08.107047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:08.121016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:08.121231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:08.124991 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.125643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.126467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.126942 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.130487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.131011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.132054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.139994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.352667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:08.367050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6d22db3a-50ed-44f9-ae7d-66be061c2c80 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 200 len: 1475 microversion: 2.1 time: 0.269686 Jan 24 16:53:08.367671 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 242/495] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:08 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 1475 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:08.376129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:08.386857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-6d37f06d-4956-482a-aafe-4b358b39f58e req-aba9093e-a2a5-4da2-adf2-e5ca572202b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d06636-896c-41fe-bbbb-6828092fd5e7", "name": "network-vif-deleted", "tag": "4c6ddf50-33be-4ddf-8e85-0eb97f669b8d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:08.390555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:08.392121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:08.393314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e1275c96-d397-4f52-b0f5-6004a6579bfe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.277154 Jan 24 16:53:08.393886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 254/496] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:08 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:08.397137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:08.397137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:53:08.407280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-6d37f06d-4956-482a-aafe-4b358b39f58e req-aba9093e-a2a5-4da2-adf2-e5ca572202b2 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.411555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-6d37f06d-4956-482a-aafe-4b358b39f58e req-aba9093e-a2a5-4da2-adf2-e5ca572202b2 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.427163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-6d37f06d-4956-482a-aafe-4b358b39f58e req-aba9093e-a2a5-4da2-adf2-e5ca572202b2 service nova] Creating event network-vif-deleted:4c6ddf50-33be-4ddf-8e85-0eb97f669b8d for instance d6d06636-896c-41fe-bbbb-6828092fd5e7 on hv-cinder-82611 Jan 24 16:53:08.438670 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-6d37f06d-4956-482a-aafe-4b358b39f58e req-aba9093e-a2a5-4da2-adf2-e5ca572202b2 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054743 Jan 24 16:53:08.439857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 243/497] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:08.730041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:08.731421 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:08.738708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.739505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.740488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:08.741619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:08.903925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:08.912914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c4ce912-eb11-458c-b9ef-a17b7f1d35a4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.187855 Jan 24 16:53:08.914224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 255/498] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:08 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:09.387513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:09.388337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: d6d06636-896c-41fe-bbbb-6828092fd5e7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:09.395314 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.395840 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.397028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.397974 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.411581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:09.412192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:09.416924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Instance d6d06636-896c-41fe-bbbb-6828092fd5e7 could not be found. Jan 24 16:53:09.417527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 404 to user: Instance d6d06636-896c-41fe-bbbb-6828092fd5e7 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:09.418352 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-18a76122-c77a-4fb9-adf4-b9e8b5b79293 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7" status: 404 len: 111 microversion: 2.1 time: 0.038140 Jan 24 16:53:09.419205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.419554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.420347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.420786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.422673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 244/499] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:09 2022] GET /compute/v2.1/servers/d6d06636-896c-41fe-bbbb-6828092fd5e7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:09.574823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:09.581989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:09.583483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:09.584651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f9ceaabc-4bc0-4f44-a476-4cd7a4b80d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.176718 Jan 24 16:53:09.585679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 256/500] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:09 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:09.777507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-755bf32b-a9fa-4cfa-977d-1112bcfd5072 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:09.783659 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-755bf32b-a9fa-4cfa-977d-1112bcfd5072 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.784110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-755bf32b-a9fa-4cfa-977d-1112bcfd5072 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.848005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-755bf32b-a9fa-4cfa-977d-1112bcfd5072 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Going to try to stop instance {{(pid=127826) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 16:53:09.909982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-755bf32b-a9fa-4cfa-977d-1112bcfd5072 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 202 len: 0 microversion: 2.1 time: 0.135993 Jan 24 16:53:09.910594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 245/501] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:53:09 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:53:09.919293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:09.920012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:09.926692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.930640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.934779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.935575 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.938848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:09.939596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:09.950308 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.956917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:09.958118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:09.958931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.128777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.141185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c6ce472d-d87d-41fd-b3d7-4422fffc75fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.225535 Jan 24 16:53:10.142063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 257/502] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:09 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:10.416569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.427226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1190a1a0-791d-455e-ac37-5999e3328fb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.498564 Jan 24 16:53:10.427988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 246/503] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:09 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:10.576309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:10.577088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:10.583355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.584111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.585394 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.586024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.604811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:10.605562 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:10.613858 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.614616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.615722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.617225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.627949 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:53:10.737135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-afe2bebc-bb69-496c-a876-2432b9da5028 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 204 len: 0 microversion: 2.1 time: 0.163939 Jan 24 16:53:10.742304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 258/504] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:53:10 2022] DELETE /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:53:10.747856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:10.748547 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:10.754911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.755359 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.756145 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:10.756730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:10.780131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.789165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.792060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.794143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f0284cbb-2d69-4d7c-9a98-d94c47b4854b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.192945 Jan 24 16:53:10.795557 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 247/505] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:10 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:10.970133 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:10.983297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a800bc37-ea85-4133-a660-7ec174e5fdea tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1519 microversion: 2.1 time: 0.239095 Jan 24 16:53:10.984346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 259/506] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:10 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:11.159484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:11.160097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:11.167559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.168015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:11.168806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.169419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:11.383398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:11.392768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d9703935-0f51-4de7-8c39-d749c98ac004 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.236835 Jan 24 16:53:11.394493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 248/507] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:11 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:11.446654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:11.447561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:11.457961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.458779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:11.461145 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.461933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:11.652448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:11.660311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6d682e48-f0e2-4cf0-a371-ef2d851e9829 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.219051 Jan 24 16:53:11.660827 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 260/508] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:11 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:11.813539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:11.814218 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:11.827674 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.828734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:11.829401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:11.833541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.001319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:12.001992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:12.016379 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.017058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.018166 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.019529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.171114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:12.181629 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:12.185386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:12.187244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5064ba95-5a6b-49ac-bd9e-6d662f768d4f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.377670 Jan 24 16:53:12.187468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:12.188169 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 249/509] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:11 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:12.205566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-22b0ddcc-e97f-4904-a069-6c0a9162497f tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1519 microversion: 2.1 time: 0.208290 Jan 24 16:53:12.206653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 261/510] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:11 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:12.422328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:12.423281 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:12.431477 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66ab0384-4348-4c56-9620-86225825dd1b", "device": "/dev/sdb"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:12.433163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:12.439472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.441440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.441896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.442686 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.443768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.444325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.445397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.447673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.803368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:12.814638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-26ddee6f-80b2-448d-aae4-9473e7535e7e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.404268 Jan 24 16:53:12.819928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 250/511] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:12 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:12.828483 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:12.829993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:12.853061 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.853610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-114fb34c-b80f-4f56-80e8-5b3a393144dd tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "POST /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426292 Jan 24 16:53:12.853752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:12.859548 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 262/512] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:53:12 2022] POST /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:12.859730 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:12.859730 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.200543 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:13.209688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0e529e5a-cb33-4f9a-8293-0458567581d3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.388339 Jan 24 16:53:13.211665 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:13.213080 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:13.223856 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 251/513] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:12 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:13.225872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.226337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.233366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:13.233585 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.233869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.234358 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:13.242417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.243294 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.246848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.247715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.540718 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:13.549146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e8482d4e-9870-415a-9a92-3124c1d449cd tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1519 microversion: 2.1 time: 0.323966 Jan 24 16:53:13.560221 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 252/514] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:13 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:13.833209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:13.833903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:13.842904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.849714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.851971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:13.852426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:13.929108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:13.941873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:13.943427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:13.945303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-eb9770e0-e8c7-479c-b7b4-3bc14d45eed0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.742385 Jan 24 16:53:13.945880 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 263/515] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:13 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:14.233685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:14.235013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:14.246602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.250387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.251252 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.254837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.337953 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:14.348300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a735c78e-1820-45fa-b550-6d19d43657ea tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.519120 Jan 24 16:53:14.352296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 253/516] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:13 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:14.409487 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-70212fe4-23fc-4b53-a6a5-2a2c8fa873fe req-c2d37681-b44b-45b2-9511-bbc2a0d63ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ca6098-0099-41ae-a01a-a19e52f1bc70", "name": "network-vif-deleted", "tag": "1c00f2bb-a862-432a-8749-d007bd44785f"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:14.411638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:14.411638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:53:14.445646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-70212fe4-23fc-4b53-a6a5-2a2c8fa873fe req-c2d37681-b44b-45b2-9511-bbc2a0d63ce7 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.451127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-70212fe4-23fc-4b53-a6a5-2a2c8fa873fe req-c2d37681-b44b-45b2-9511-bbc2a0d63ce7 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.488101 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-70212fe4-23fc-4b53-a6a5-2a2c8fa873fe req-c2d37681-b44b-45b2-9511-bbc2a0d63ce7 service nova] Creating event network-vif-deleted:1c00f2bb-a862-432a-8749-d007bd44785f for instance b5ca6098-0099-41ae-a01a-a19e52f1bc70 on hv-cinder-82611 Jan 24 16:53:14.502690 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-70212fe4-23fc-4b53-a6a5-2a2c8fa873fe req-c2d37681-b44b-45b2-9511-bbc2a0d63ce7 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101315 Jan 24 16:53:14.503877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 254/517] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:14.576576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:14.577630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:14.604806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.609008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.611385 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.616821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.660426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:14.671809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4cb3c746-707f-4f45-a07c-cdaf044534c3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.441879 Jan 24 16:53:14.675882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 264/518] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:14 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:14.677226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.677860 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.678520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'fault' on Instance uuid b5ca6098-0099-41ae-a01a-a19e52f1bc70 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:14.764721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:14.777688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d2b2c551-675c-4ed5-b271-2b7fafcd6990 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 200 len: 1312 microversion: 2.1 time: 0.212825 Jan 24 16:53:14.783667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 255/519] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:14 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 1312 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:14.973494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:14.973695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:14.987204 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.987935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:14.988950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:14.989599 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.322072 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:15.333052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:15.334619 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:15.335832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e308fe5a-d667-4407-82cd-e917825105f4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.374321 Jan 24 16:53:15.336398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 265/520] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:14 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:15.367675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:15.368302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:15.379230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.380178 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.382257 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.383074 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.574956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:15.582975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d4bbed7c-a81a-466c-8ca5-5f01b528c5ee tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.220883 Jan 24 16:53:15.583554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 256/521] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:15 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:15.692982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:15.693602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:15.705552 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.706216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.707106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.707548 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.799420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:15.800979 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: b5ca6098-0099-41ae-a01a-a19e52f1bc70] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:15.807429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.808124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.808926 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.809527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.825180 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Instance b5ca6098-0099-41ae-a01a-a19e52f1bc70 could not be found. Jan 24 16:53:15.825817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 404 to user: Instance b5ca6098-0099-41ae-a01a-a19e52f1bc70 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:15.826988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-547f244d-d287-450d-aed0-b2673a393bcb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jan 24 16:53:15.827556 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 257/522] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:15 2022] GET /compute/v2.1/servers/b5ca6098-0099-41ae-a01a-a19e52f1bc70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:15.840142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:15.841267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:15.848500 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.849120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.850770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:15.851489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:15.883605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:53:15.957208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:15.973789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1fb17603-d4b5-4e08-a633-45c0a81a9b88 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.284185 Jan 24 16:53:15.974526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 266/523] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:15 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:16.037112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cb1b87e1-a026-41ec-ada8-4072c6df48db tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 204 len: 0 microversion: 2.1 time: 0.205066 Jan 24 16:53:16.038542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 258/524] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:53:15 2022] DELETE /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 16:53:16.046372 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:16.047007 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:16.053581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.053967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.054775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.055213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.344639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:16.354349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:16.355324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:16.361995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-309bd12a-3399-492f-b38f-e293ba09f4c6 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1519 microversion: 2.1 time: 0.319221 Jan 24 16:53:16.362584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 267/525] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:16 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:16.375795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.376405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.377356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.378036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.540877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:16.548912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:16.550429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:16.551618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6aa6b55a-d39a-4724-b1c5-a78f0f768c72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.201483 Jan 24 16:53:16.552831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 259/526] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:16 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:16.600845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:16.601624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:16.610208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.610910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.612153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:16.612797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:16.769389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:16.777991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4381e383-effd-4c17-9101-c36e5b1feee4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.180905 Jan 24 16:53:16.778572 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 268/527] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:16 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:16.991367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:16.992193 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:16.999613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.000134 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.000855 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.001293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.194611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:17.205695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f9e2fe83-4769-49c1-8bc5-024f0e0371bc tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.217916 Jan 24 16:53:17.206277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 260/528] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:16 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:17.381493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:17.384628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:17.391433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.392169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.393333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.393988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.557028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:17.570049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9242b86b-5182-4bbc-b50b-7566282a6622 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1519 microversion: 2.1 time: 0.193298 Jan 24 16:53:17.570463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:17.571608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:17.588216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 269/529] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:17 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:17.590435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.591125 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.592089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.592683 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.790913 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:17.798728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:17.799663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:17.810167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:17.813195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.813874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.815923 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:17.816529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:17.817424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:17.820522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-010bb8cd-e234-4251-a220-3eafc0a3a8e7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1747 microversion: 2.20 time: 0.253897 Jan 24 16:53:17.832599 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 261/530] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:17 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1747 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:18.047451 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:18.057106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a30b32c8-6392-45e1-811c-b8bca285f5e9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.264514 Jan 24 16:53:18.067106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 270/531] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:17 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:18.224213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:18.225691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:18.236099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.236843 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:18.238016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.238462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:18.510654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:18.529781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4a6371dd-f7a2-4ac0-bd02-361212bdd836 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.310292 Jan 24 16:53:18.530561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 262/532] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:18 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:18.602661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:18.604167 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:18.618176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.619074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:18.620083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.620724 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:18.827361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:18.838152 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-85305554-198d-47fb-b399-a5103ced4a89 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1519 microversion: 2.1 time: 0.246971 Jan 24 16:53:18.840008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 271/533] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:18 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:18.841750 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:18.842574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:18.857436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.861442 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:18.862350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:18.866618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.074930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:19.075840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:19.088013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.092193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.094295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.095035 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.305561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:19.317789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:19.320471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:19.325315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0eaaec77-b718-4aec-93f5-d636be41be78 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1747 microversion: 2.20 time: 0.487428 Jan 24 16:53:19.327196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 263/534] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:18 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1747 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:19.338697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:19.348727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-36c8d3c0-f563-48c1-b111-c72b5b3430b3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.278471 Jan 24 16:53:19.350411 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 272/535] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:19 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:19.547479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:19.548100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:19.557408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.566768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-12febbb0-5f8d-4241-8ac6-9b3891c9fa53 req-aa05f2a0-7a05-4fd1-8c0d-7ccf25ce5244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b09775-5279-4d04-af95-32c544e2b423", "name": "network-vif-deleted", "tag": "efc223cc-bc5e-4cdf-a92f-b066f43ca860"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:19.568895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:19.568895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:53:19.571584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.573685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.577580 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-12febbb0-5f8d-4241-8ac6-9b3891c9fa53 req-aa05f2a0-7a05-4fd1-8c0d-7ccf25ce5244 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.578280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.587541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-12febbb0-5f8d-4241-8ac6-9b3891c9fa53 req-aa05f2a0-7a05-4fd1-8c0d-7ccf25ce5244 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.613771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-12febbb0-5f8d-4241-8ac6-9b3891c9fa53 req-aa05f2a0-7a05-4fd1-8c0d-7ccf25ce5244 service nova] Creating event network-vif-deleted:efc223cc-bc5e-4cdf-a92f-b066f43ca860 for instance e2b09775-5279-4d04-af95-32c544e2b423 on hv-cinder-82611 Jan 24 16:53:19.625764 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-12febbb0-5f8d-4241-8ac6-9b3891c9fa53 req-aa05f2a0-7a05-4fd1-8c0d-7ccf25ce5244 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062533 Jan 24 16:53:19.627244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 273/536] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:19.805983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:19.819880 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4f26563f-b074-4149-a8de-4bb2bd176857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.276042 Jan 24 16:53:19.832434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 264/537] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:19 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:19.857253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:19.857963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:19.875567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.876248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.877095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.877538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.946440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:19.946929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:19.949906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'fault' on Instance uuid e2b09775-5279-4d04-af95-32c544e2b423 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:20.033806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:20.043921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1d7b4bfe-d09a-43af-9359-7f3443150e5b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 200 len: 1312 microversion: 2.1 time: 0.190930 Jan 24 16:53:20.044928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 274/538] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:19 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:20.345829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:20.347210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:20.357626 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.360833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:20.363158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.366249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:20.367630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:20.371841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:20.383617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.389438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:20.392010 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.394384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:20.639943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:20.653881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:20.658745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:20.663770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fe90f0aa-b957-4cc6-ae47-408477bf9f68 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.322195 Jan 24 16:53:20.678722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 265/539] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:20 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:20.779241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:20.801122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-34572811-17e6-48d8-abe9-fa585b496b76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.437852 Jan 24 16:53:20.801719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 275/540] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:20 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:20.850900 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:20.853326 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:20.881494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.884825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:20.886050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:20.890936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.062299 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:21.066268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: e2b09775-5279-4d04-af95-32c544e2b423] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:21.078078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.081134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.082319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.083214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.100245 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Instance e2b09775-5279-4d04-af95-32c544e2b423 could not be found. Jan 24 16:53:21.102290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 404 to user: Instance e2b09775-5279-4d04-af95-32c544e2b423 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:21.104191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-78dc3d46-6471-4a69-ac6c-c2c5b9a693ab tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423" status: 404 len: 111 microversion: 2.1 time: 0.046735 Jan 24 16:53:21.106538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 276/541] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:21 2022] GET /compute/v2.1/servers/e2b09775-5279-4d04-af95-32c544e2b423 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:21.195400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:21.206273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7f2f4ee4-f7fa-4916-af40-69c3f8c4090d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.367798 Jan 24 16:53:21.216724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 266/542] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:20 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:21.684318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:21.685532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:21.706446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.707314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.708859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.709570 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.819172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:21.820694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:21.837529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.838148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.840956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:21.842149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:21.950674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:22.027644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:22.031725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:22.035262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-88dbf8f4-f5f6-40bc-b08d-9685d024562f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.354605 Jan 24 16:53:22.052212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 277/543] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:21 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:22.151202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:22.160002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8a1ea6c9-8b65-4eee-a0ef-f999e529a4f8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.345057 Jan 24 16:53:22.161671 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 267/544] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:21 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:22.223934 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:22.224901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:22.234621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:22.239303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:22.240407 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:22.241067 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:22.518811 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:22.529718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5784fea5-3d66-4ebe-91a9-27cc43d5f8c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.309464 Jan 24 16:53:22.530576 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 278/545] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:22 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:23.056871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:23.058161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:23.077465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.078248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.079550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.080176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.179734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:23.180313 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:23.192009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.192310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.193179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.199590 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.263847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:23.272184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:23.273707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:23.284031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1f4af5c6-07db-45f8-beb5-cf8200ac7efe tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.232594 Jan 24 16:53:23.296324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 268/546] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:23 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:23.381542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:23.393071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-63ab92a9-260a-4600-a184-973b9cdafb38 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.217648 Jan 24 16:53:23.396129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 279/547] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:23 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:23.547506 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:23.548423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:23.561198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.561937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.563068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:23.563687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:23.738231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:23.748016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ea76ac73-5a03-4ebe-b816-29d9035ed097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.204038 Jan 24 16:53:23.750391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 269/548] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:23 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:24.304815 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:24.306124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:24.316686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.318006 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.319581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.320217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.411181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:24.412538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:24.423960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.424811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.425826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.427263 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.591807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:24.601980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:24.609406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:24.612714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-add45d16-4e4d-40aa-a17e-455d932bfe87 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.312798 Jan 24 16:53:24.614681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 280/549] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:24 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:24.711651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:24.728700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-77092a10-1f04-4aee-86df-6d20db905428 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.321209 Jan 24 16:53:24.730048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 270/550] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:24 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:24.732652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-5ec1bdb6-0748-40ec-9336-d0bd40ccfdb7 req-d5c28b24-5604-4483-a368-f44dabcadf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "name": "network-vif-plugged", "status": "completed", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:24.734331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:24.734331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:53:24.746295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-5ec1bdb6-0748-40ec-9336-d0bd40ccfdb7 req-d5c28b24-5604-4483-a368-f44dabcadf40 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.746792 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-5ec1bdb6-0748-40ec-9336-d0bd40ccfdb7 req-d5c28b24-5604-4483-a368-f44dabcadf40 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.769739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:24.770867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:24.779733 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-5ec1bdb6-0748-40ec-9336-d0bd40ccfdb7 req-d5c28b24-5604-4483-a368-f44dabcadf40 service nova] Creating event network-vif-plugged:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:53:24.792203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-5ec1bdb6-0748-40ec-9336-d0bd40ccfdb7 req-d5c28b24-5604-4483-a368-f44dabcadf40 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062029 Jan 24 16:53:24.794487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 281/551] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:24.795515 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.796030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:24.796917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:24.797629 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.042723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:25.050685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-eff2c82d-ca1b-4b82-a939-b42bc3f578a8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.285103 Jan 24 16:53:25.055179 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 271/552] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:24 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:25.618714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:25.619330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:25.631480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:25.632805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:25.640717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.641170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.641958 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.644667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.645119 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.645905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.653795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.654445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.712070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:53:25.891930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:25.896914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-233c037c-6e28-4224-a24b-b0f34f73592c tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "DELETE /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 204 len: 0 microversion: 2.1 time: 0.282635 Jan 24 16:53:25.897725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 282/553] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:53:25 2022] DELETE /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:53:25.904180 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:25.906131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:25.907746 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e875e696-70cd-4ae9-9569-0bdc90794555 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.279910 Jan 24 16:53:25.908912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 272/554] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:25 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:25.916318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:25.918254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:25.919032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:25.919964 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:25.929740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.930190 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.931026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.931467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.935835 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.939064 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:25.940056 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:25.940687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:26.107562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:26.116244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-16685276-0c7d-4d7c-b2f4-a599356cf6fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.217397 Jan 24 16:53:26.117254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 283/555] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:25 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:26.126988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:26.127677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:26.150207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:26.155692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:26.156724 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:26.157598 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:26.216872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:26.224495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a3a93fe0-89f3-45a2-a076-9437ec778ec9 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.314296 Jan 24 16:53:26.228541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 273/556] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:25 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:26.319260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:26.328571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-024d4908-8a90-4744-b731-30e6ebe90537 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.210052 Jan 24 16:53:26.331258 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 284/557] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:26 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:26.930478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:26.931212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:26.944609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:26.945720 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:26.946534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:26.947021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.142952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:27.143611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:27.161061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.161548 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.162732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.163266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.238729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.254230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.260439 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.261827 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c35c8f06-87e7-4148-8381-7ba15b016b55 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.338754 Jan 24 16:53:27.266210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 274/558] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:26 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:27.276404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:27.277071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:27.291121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.291855 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.292863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.293514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.361251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.377192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fbf2a563-67cd-4fd2-8827-4202dec6247a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.247125 Jan 24 16:53:27.378056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 285/559] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:27 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:27.385206 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:27.391538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:27.412467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.418293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.429499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:27.429975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:27.489701 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.502097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4609539b-d609-475f-8578-8e716d976fb2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.234732 Jan 24 16:53:27.506054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 275/560] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:27 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:27.649425 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:27.656856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7782f595-8d3f-46d2-b7fe-3e32c8210fba tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.277522 Jan 24 16:53:27.657608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 286/561] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:27 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:28.296146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:28.296146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:28.296146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.296911 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.296994 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.302802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.397216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:28.397906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:28.409756 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.410214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.411034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.411558 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.549660 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.569271 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.577915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.582839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-813c82ca-4cf2-4aaa-9e82-69d44c12b850 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.298115 Jan 24 16:53:28.591900 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 276/562] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:28 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:28.597858 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:28.602034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:28.620071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.621640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.623870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.627087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.748025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.757522 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ee15c19f-a810-42d0-b77c-54a1e8d042e7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.365363 Jan 24 16:53:28.758718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 287/563] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:28 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:28.772954 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:28.773876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:28.780841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.781607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.782658 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:28.783367 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:28.908811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.917001 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6313ce46-5694-459e-b863-31ed18584b76 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.323913 Jan 24 16:53:28.917589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 277/564] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:28 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:28.956041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:28.967962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2af3c771-47c1-45a0-aef9-fe888b6f5857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.198475 Jan 24 16:53:28.979531 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 288/565] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:28 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:29.368241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'create', calling method: .version_select at 0x7fba14f9faf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-176443666"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:29.393620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for project d60ca23ca0784aef8638d92cfdca914f. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:53:29.401234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for user d07e0cd23d0c4f2ab7aba38a564dc693 and project d60ca23ca0784aef8638d92cfdca914f. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:53:29.415273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [dba689b1-ad46-4b83-9e50-938db30bf8e9] AMQP server on 10.222.0.117:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 24 16:53:29.609260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:29.610173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:29.617373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:29.620950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:29.623577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:29.625052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:29.819568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:29.829472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:29.832852 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:29.836662 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-32e2b19d-7cca-4c39-b771-6667c0ac72da tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.230037 Jan 24 16:53:29.848437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 289/566] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:29 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:29.848437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:29.848437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:29.853043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:29.853497 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:29.854283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:29.854725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.003086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:30.011268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-554c83a1-096b-4bbf-8e47-cee48da50d6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.171525 Jan 24 16:53:30.013186 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 290/567] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:29 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:30.018195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:30.018659 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:30.025221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.025679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.026475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.027055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.178393 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:30.190663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d0e0c6f1-eea4-40f4-b6db-da7754d042d2 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.176225 Jan 24 16:53:30.191410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 291/568] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:30 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:30.195928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:30.196745 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:30.202951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.203518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.204343 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.204856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.351740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:30.360006 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-33253a33-23da-4961-8b17-12465ef3b5c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.167403 Jan 24 16:53:30.360651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 292/569] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:30 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:30.422311 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [dba689b1-ad46-4b83-9e50-938db30bf8e9] Reconnected to AMQP server on 10.222.0.117:5672 via [amqp] client with port 41128. Jan 24 16:53:30.513901 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for project d60ca23ca0784aef8638d92cfdca914f. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:53:30.518080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for user d07e0cd23d0c4f2ab7aba38a564dc693 and project d60ca23ca0784aef8638d92cfdca914f. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:53:30.532492 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-03be0564-1232-42fd-9177-1455368f5206 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.168921 Jan 24 16:53:30.533376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 278/570] 10.222.0.117 () {60 vars in 1162 bytes} [Mon Jan 24 16:53:29 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:30.585221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1275259447", "imageRef": "71dc6f83-2e48-4622-9ad8-6ae46f0230f0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-176443666", "networks": [{"uuid": "79c56179-49d8-45c0-b697-75d837624748"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:30.640165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] validate_networks() for [('79c56179-49d8-45c0-b697-75d837624748', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:53:30.859560 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:30.861287 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:30.868195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.868653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:30.870321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:30.870321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.047417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.056666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.058577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.060371 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-776141df-debb-4b45-a4ce-daf7c3d93b50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.205443 Jan 24 16:53:31.063632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:53:31.063949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 279/571] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:30 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:31.064122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:53:31.064561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:53:31.064971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:53:31.065646 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:53:31.071821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:31.073736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:31.080511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.080689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.081101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.081594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.081928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.082370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.083058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.083760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.105924 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for project d60ca23ca0784aef8638d92cfdca914f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:53:31.110653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Getting quotas for user d07e0cd23d0c4f2ab7aba38a564dc693 and project d60ca23ca0784aef8638d92cfdca914f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:53:31.124625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:53:31.127072 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71dc6f83-2e48-4622-9ad8-6ae46f0230f0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:53:31.193372 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e863dc25-3dee-4b6b-a139-6d92012702af tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.612400 Jan 24 16:53:31.194323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 293/572] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:53:30 2022] POST /compute/v2.1/servers => generated 382 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 16:53:31.203980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d60cf85a-a997-42b8-b21a-be79460337db tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:31.204607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d60cf85a-a997-42b8-b21a-be79460337db tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:31.261692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.273549 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f0a98aeb-8afa-4bfd-b8b0-857ac2b10d90 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.204276 Jan 24 16:53:31.283486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 280/573] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:31 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:31.288816 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:31.288990 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:31.295538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.295995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.296391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d60cf85a-a997-42b8-b21a-be79460337db tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.296789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.297230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.308822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d60cf85a-a997-42b8-b21a-be79460337db tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1262 microversion: 2.1 time: 0.108227 Jan 24 16:53:31.312600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 294/574] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:31 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1262 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:31.382000 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:31.382796 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:31.390302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.390785 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.391737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:31.392369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:31.469204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.479216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-44a1cbbf-47c7-40f4-9292-00616a093f04 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.194551 Jan 24 16:53:31.480381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 281/575] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:31 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:31.588268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:31.601859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0a8f453f-8446-4929-8341-d4fb8846b23f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.227237 Jan 24 16:53:31.612097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 295/576] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:31 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:32.079353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:32.079877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:32.086698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.087168 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.087951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.088388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.222587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.230411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.231946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.233102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3ce056de-1d29-4e79-90a5-8098ea327852 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.158084 Jan 24 16:53:32.233664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 282/577] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:32 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:32.290658 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:32.291306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:32.297525 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.297966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.298733 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.299192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.328210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:32.328825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:32.335588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.335981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.336808 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.337290 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.398440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.406015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4ef69e57-2b28-4b26-8fa5-3095445dcf30 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1266 microversion: 2.1 time: 0.081373 Jan 24 16:53:32.406595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 283/578] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:32 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:32.436903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.444647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f774c12f-fb29-4ab8-a8e1-f1c3df16fb4f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.158553 Jan 24 16:53:32.445202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 296/579] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:32 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:32.497051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:32.497668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:32.503642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.504096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.504878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.505315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.619150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:32.620127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:32.626199 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.626787 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.627676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:32.628374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:32.640042 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.648267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-07034896-020c-4fbc-8621-0816b19d3d26 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.154824 Jan 24 16:53:32.649243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 284/580] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:32 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:32.766157 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:32.774933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c8953a69-3bfe-482c-86fd-6c015eca7f19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.159430 Jan 24 16:53:32.775504 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 297/581] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:32 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:33.250553 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:33.251181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:33.256892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.257333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.258094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.258525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.399742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.407356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.408920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.410024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0818b59c-47a9-41b4-9788-103f64df0823 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1742 microversion: 2.20 time: 0.163085 Jan 24 16:53:33.410578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 285/582] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:33 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:33.422966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:33.423589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:33.429930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.430381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.431213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.431652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.462591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:33.463220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:33.469267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.469709 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.470481 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.470937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.494202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.501629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f3c79e29-aa21-4b7c-95bc-c0cd0384a955 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1314 microversion: 2.1 time: 0.082449 Jan 24 16:53:33.502231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 298/583] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:33 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1314 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:33.602328 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.610426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-35661b09-b7b9-4d06-8dd3-7625faac555e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.152439 Jan 24 16:53:33.611144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 286/584] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:33 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:33.666023 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:33.666640 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:33.672348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.672800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.673583 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.674022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.792239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:33.793097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:33.799491 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.799944 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.800738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:33.801190 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:33.812790 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:33.820560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ab0c2d57-488d-4c95-b2d2-283e729f7397 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1518 microversion: 2.1 time: 0.159175 Jan 24 16:53:33.821220 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 299/585] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:33 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:34.054981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.065288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d412892d-b401-46d9-b341-15c17da53e40 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.276634 Jan 24 16:53:34.065960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 287/586] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:33 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:34.431200 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:34.433512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:34.440968 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.441587 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.443900 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.444340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.518283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:34.519541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:34.532703 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.533110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.533901 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.534332 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.616636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.631987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a0441719-ed78-4051-be3b-0d545f501f14 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1320 microversion: 2.1 time: 0.118420 Jan 24 16:53:34.633112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 288/587] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:34 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1320 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:34.650652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:34.651856 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:34.660036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.660776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.662411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:34.663811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:34.912251 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.940344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.951091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.961652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:34.965300 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3007dcc4-fcfc-4dfa-8cc8-1fa0babbf491 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.536988 Jan 24 16:53:34.971346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 300/588] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:34 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:34.979313 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d7dc4e3c-019e-470e-ae15-45b1c3ed70c9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.318812 Jan 24 16:53:34.984282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 289/589] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:34 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:34.991199 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:34.994836 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:35.023693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.026067 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.027824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.033447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.097184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:35.101384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:35.133356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.134881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.148256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.166779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.251689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:35.264163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-31c6b736-7160-4e65-8a41-6528253daf6b tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1476 microversion: 2.1 time: 0.290969 Jan 24 16:53:35.266181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 301/590] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:34 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:35.289748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-885d762e-cbb1-43d1-9abb-15b53658c921 req-7b8d37bc-fc8b-4485-b902-61834a9a44a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffea6bfd-3cc1-438b-b7c3-29079c646252", "name": "network-vif-deleted", "tag": "6ede1577-59cb-4655-a23e-cc2ffa5c3c79"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:35.292419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:35.292419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:53:35.305643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-885d762e-cbb1-43d1-9abb-15b53658c921 req-7b8d37bc-fc8b-4485-b902-61834a9a44a6 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.307564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-885d762e-cbb1-43d1-9abb-15b53658c921 req-7b8d37bc-fc8b-4485-b902-61834a9a44a6 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.348209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-885d762e-cbb1-43d1-9abb-15b53658c921 req-7b8d37bc-fc8b-4485-b902-61834a9a44a6 service nova] Creating event network-vif-deleted:6ede1577-59cb-4655-a23e-cc2ffa5c3c79 for instance ffea6bfd-3cc1-438b-b7c3-29079c646252 on hv-cinder-82611 Jan 24 16:53:35.369526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-885d762e-cbb1-43d1-9abb-15b53658c921 req-7b8d37bc-fc8b-4485-b902-61834a9a44a6 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101469 Jan 24 16:53:35.373307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 302/591] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:35.480178 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:35.501480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fb132233-d8f2-4c10-8b3c-9763b0a82205 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.420796 Jan 24 16:53:35.514804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 290/592] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:35 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:35.654635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:35.668856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:35.694042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.704107 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.705842 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.706887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:35.904651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:35.915196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-16b19ee8-5893-47c0-a831-c94895d22ec0 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.266795 Jan 24 16:53:35.916319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 303/593] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:35 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:35.991537 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:35.992204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:35.999323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:35.999781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.000693 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.001202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.010878 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:36.012591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:36.019340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.020017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.021205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.021980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.182176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.194889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.204688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9ddef0a4-3847-4637-88b2-0d7ac89feebb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.207036 Jan 24 16:53:36.205621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.208337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.208840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 304/594] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:35 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:36.211091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-385b95b1-d85b-4fa0-b2b4-2907d2203108 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.223718 Jan 24 16:53:36.221608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 291/595] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:35 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:36.284140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:36.284767 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:36.291905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.292358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.293174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.293604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.363546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.371156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a1af3928-df41-4c93-906c-ec0a63ac069a tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.091223 Jan 24 16:53:36.371749 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 305/596] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:36 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:36.529521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:36.530132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:36.537629 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.538129 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.539074 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.539518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.680446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:36.690559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2083fed0-25ea-45f4-b0c1-8d1e6915382f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.164699 Jan 24 16:53:36.699373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 292/597] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:36 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:36.932976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:36.933536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:36.940098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.940546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:36.941322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:36.941757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.093958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.102142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ab7e852b-087b-4e06-bc84-091e3a81d777 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.172809 Jan 24 16:53:37.103179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 306/598] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:36 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:37.223149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:37.223902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:37.229993 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:37.230170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.230511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.230613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:37.231324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.231769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.236389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.236828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.237606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.238036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.377105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.385973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ceda5a04-55d7-45f3-b8d0-735296da65a9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.166532 Jan 24 16:53:37.386773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 293/599] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:37 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:37.391387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:37.392031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:37.400354 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.400574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.401319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.401905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.410532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.418485 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.420017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.421171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-bb5bd3e4-f4d1-4019-b3fc-7db5090efb99 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.194771 Jan 24 16:53:37.421731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 307/600] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:37 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:37.430897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:37.430897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:37.433264 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.433973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.435185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.435633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.519053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lazy-loading 'services' on Instance uuid 0eb0d520-edd0-431c-983e-6560a5669811 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:37.525618 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.533243 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c12e10e7-20b5-4753-a7e0-ec8b62aafe0e tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.110572 Jan 24 16:53:37.534012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 308/601] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:37 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:37.601928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-570e1eb5-683e-434d-9908-c021e6c2fc48 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "DELETE /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811/os-volume_attachments/66ab0384-4348-4c56-9620-86225825dd1b" status: 202 len: 0 microversion: 2.1 time: 0.213633 Jan 24 16:53:37.602527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 294/602] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:53:37 2022] DELETE /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811/os-volume_attachments/66ab0384-4348-4c56-9620-86225825dd1b => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:53:37.709264 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:37.709871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:37.716331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.716784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.717579 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:37.718024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:37.875807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:37.892326 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2d2d8bac-1eb8-4991-bf88-8f1ca4253896 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.186630 Jan 24 16:53:37.892929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 309/603] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:37 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:38.121730 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:38.131285 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:38.148295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.149443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.150411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.151026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.321858 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.329210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5648a1c3-6b54-4f8c-a795-211f8a31f1ce tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.211931 Jan 24 16:53:38.329772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 295/604] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:38 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:38.403174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:38.404542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:38.411737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.412529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.413567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.414230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.446090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:38.447003 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:38.453654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.454646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.455643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.456150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.595125 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.609586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.617184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-51823fed-9ae1-4a10-bc76-e2a412952eab tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.213969 Jan 24 16:53:38.619783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.620612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 310/605] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:38 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:38.624344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.627327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dfca03b5-de21-43c4-a3f4-63110130001e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.185627 Jan 24 16:53:38.627919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 296/606] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:38 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:38.632703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:38.633448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:38.639950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.640467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.641347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.642038 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.644761 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-4d1fb6c4-5b7e-41b9-98fb-bcb47126bf95 req-bc59572d-fff0-43e3-a849-f6ae126bba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "name": "network-vif-unplugged", "status": "completed", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:38.647049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:38.647049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:53:38.654547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-4d1fb6c4-5b7e-41b9-98fb-bcb47126bf95 req-bc59572d-fff0-43e3-a849-f6ae126bba83 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.655021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-4d1fb6c4-5b7e-41b9-98fb-bcb47126bf95 req-bc59572d-fff0-43e3-a849-f6ae126bba83 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.669037 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-4d1fb6c4-5b7e-41b9-98fb-bcb47126bf95 req-bc59572d-fff0-43e3-a849-f6ae126bba83 service nova] Creating event network-vif-unplugged:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:53:38.674303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-4d1fb6c4-5b7e-41b9-98fb-bcb47126bf95 req-bc59572d-fff0-43e3-a849-f6ae126bba83 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034411 Jan 24 16:53:38.675225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 297/607] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:38.727654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:38.738647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ec248e7f-8023-4bb2-b94f-2d0010d40398 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.116505 Jan 24 16:53:38.739975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 311/608] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:38 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:38.910610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:38.911551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:38.918227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.918680 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:38.919520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:38.919961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.055524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.066494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-39cb7552-f2b5-4ee5-9e6e-4a6f09149ec7 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.159945 Jan 24 16:53:39.067267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 298/609] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:38 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:39.345323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:39.346035 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:39.353016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.353624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.354559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.355230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.488333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.496208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e8be615b-ef45-42c9-b80f-7756fb203846 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.154688 Jan 24 16:53:39.496766 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 312/610] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:39 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:39.634400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:39.634980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:39.641202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.641652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.642425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.642961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.646330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:39.648400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:39.652838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.653288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.654075 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.654511 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.807247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.815211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.816753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.818018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dab454a9-9dfe-4128-8739-eef6652ef390 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.175281 Jan 24 16:53:39.829290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 313/611] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:39 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:39.829653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.829760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:39.829760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:39.829999 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.830448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.831271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:39.831706 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:39.832092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9f7f12ee-c627-41e8-8301-21e110321b7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.202492 Jan 24 16:53:39.832717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 299/612] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:39 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:39.903397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:39.911257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3666655d-9734-4132-80ab-d952ffc81476 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.091109 Jan 24 16:53:39.911821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 314/613] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:39 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:40.084081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:40.084719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:40.090583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.091067 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.091845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.092306 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.235735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:40.254379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f6fb0a1c-06ea-4748-9379-40ec6ec0dd07 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.173581 Jan 24 16:53:40.256170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 300/614] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:40 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:40.513206 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:40.514630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:40.520839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.521440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.522228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.522658 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.668481 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:40.676029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7b641238-7aec-413b-8748-cf9bf42709ed tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.166458 Jan 24 16:53:40.684922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 315/615] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:40 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:40.836920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:40.837527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:40.844834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.845575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.846608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.847272 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.848925 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:40.849545 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:40.855862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.856308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:40.857217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:40.857797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.002887 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.013904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.016233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.017951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ac280c32-933a-4e35-960f-63d86c285b64 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.184626 Jan 24 16:53:41.027937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.030637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 301/616] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:40 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:41.033486 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-04e26c2f-6a67-467f-b0eb-143a2055693c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.187995 Jan 24 16:53:41.034229 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 316/617] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:40 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:41.036938 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:41.037557 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:41.044214 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.044668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.045465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.045936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.108778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.117114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1a30cd49-475c-4987-930f-ed07fef9e9cb tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.084101 Jan 24 16:53:41.117797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 302/618] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:41 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:41.272053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:41.273181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:41.279898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.280544 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.281568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.282314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.434068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.442861 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f29b76fd-fc81-496b-bb09-41a44bfd50d4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.174472 Jan 24 16:53:41.446804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 317/619] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:41 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:41.702783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:41.703342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:41.709353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.709805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.710612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:41.711192 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:41.865186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:41.872903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cc8017a1-764f-496b-8788-d7d8723523df tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.173864 Jan 24 16:53:41.873478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 303/620] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:41 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:42.038019 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:42.038671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:42.045088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.045535 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.046409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.046879 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.050645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:42.051849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:42.057525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.057969 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.059026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.059455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.194965 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.203928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1037c3e6-2530-4c59-aa5b-366b90fccabb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.156816 Jan 24 16:53:42.204705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 304/621] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:42 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:42.216629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.221864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:42.222468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:42.225593 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.227141 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.228293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f0e0b72f-2ee2-427f-b7ea-0738e8e4b8dc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.194699 Jan 24 16:53:42.228837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.228952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 318/622] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:42 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:42.229289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.230070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.230501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.310445 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.318922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bbff28da-ce5b-4714-8812-6bb36150c4c3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.100454 Jan 24 16:53:42.320370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 305/623] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:42 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:42.461630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:42.462261 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:42.468285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.468736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.469524 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.469965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.603559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:42.612054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-61aa4162-80a4-4b2c-b245-061c5948642c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.155144 Jan 24 16:53:42.612639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 319/624] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:42 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:42.890062 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:42.890640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:42.897290 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.897747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:42.898539 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:42.899004 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.042099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.057781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3616bcf0-f959-4783-b786-7310ac0d1fef tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.171391 Jan 24 16:53:43.058770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 306/625] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:42 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:43.220660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:43.221262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:43.227839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.228298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.229085 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.229527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.246805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:43.247451 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:43.260649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.261113 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.262087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.262381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.377475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.387042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-bae59941-5200-4c92-8ec1-8ee9c2eed9f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.169901 Jan 24 16:53:43.398013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 320/626] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:43 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:43.403374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:43.404063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:43.411856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.412236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.413130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.413642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.427043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.437885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.440425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.442987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bef82b1b-66ed-4ed8-a364-6d2057a2bc10 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.199704 Jan 24 16:53:43.445929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 307/627] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:43 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:43.476151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.483909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b26e19b9-c847-4f58-9eae-6d68df13e635 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.084743 Jan 24 16:53:43.484475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 321/628] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:43 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:43.629233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:43.629946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:43.636479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.636977 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.637794 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:43.638259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:43.777017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:43.784770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1eb81891-a34d-48c7-84b3-3075c71f1b19 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.159355 Jan 24 16:53:43.786319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 308/629] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:43 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:44.074746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:44.075444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:44.081276 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.081719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.083012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.083534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.225751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.236515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-85ccec89-408a-4633-8248-823d1038d93f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.165164 Jan 24 16:53:44.237039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 322/630] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:44 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:44.404349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:44.404992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:44.411594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.412046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.412838 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.413266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.464179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:44.464876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:44.471098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.471649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.472667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.472960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.569462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.578162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6a24ecf0-4205-4be8-b0b0-81afd8b6c4c3 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.177339 Jan 24 16:53:44.585344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 309/631] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:44 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:44.598167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:44.601711 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:44.609562 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.610022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.610876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.611321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.646816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.655270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.657111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.658445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8205f72e-6f06-4aaf-8b29-9e5313c7e7c8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.198391 Jan 24 16:53:44.670270 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 323/632] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:44 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:44.686032 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.694628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-458b839b-84d4-458b-9c84-2278c9fd23e3 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1307 microversion: 2.1 time: 0.107745 Jan 24 16:53:44.695222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 310/633] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:44 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:44.803457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:44.804188 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:44.810315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.810794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.811585 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:44.812023 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:44.947892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:44.956133 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a7f539b9-49dd-42f6-9efc-b34b68ca208c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.156763 Jan 24 16:53:44.956832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 324/634] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:44 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:45.253226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:45.253921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:45.260367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.260826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.261604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.262040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.392853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:45.400596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3340cc60-8248-405f-87d5-11b44c239575 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.151070 Jan 24 16:53:45.401154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 311/635] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:45 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:45.603592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:45.604202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:45.610736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.611224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.612023 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.612461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.678995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:45.679614 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:45.687786 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.688410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.689361 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.689856 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.872333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:45.881683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8b4bd911-5197-4f84-8075-614ae373970d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1729 microversion: 2.1 time: 0.281255 Jan 24 16:53:45.882213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 325/636] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:45 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1729 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:45.887157 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:45.888289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:45.895161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.895908 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.896888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.897494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.935335 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:45.935931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:45.936505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lazy-loading 'fault' on Instance uuid ffea6bfd-3cc1-438b-b7c3-29079c646252 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:45.988813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb8ddf0abd84c1caed8501c57b56f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f1bf5dafe744d48d952fbe6209dd79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:45.997381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-eaea8b16-9fa1-4969-acfe-3363bc066d35 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 200 len: 1312 microversion: 2.1 time: 0.113836 Jan 24 16:53:45.998286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 326/637] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:45 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:46.002587 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:46.003304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:46.009686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.010252 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.011166 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.011682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.173734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:46.182283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:46.184757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:46.195227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8d68f701-69fc-4077-82e3-e900fecdb8f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.521801 Jan 24 16:53:46.195822 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 312/638] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:45 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:46.208301 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:46.216308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-38f3ea44-d350-4a2c-8acd-3d76c6f3bd97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.217113 Jan 24 16:53:46.221302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 327/639] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:45 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:46.418866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:46.419663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:46.427178 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.427640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.428445 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.428880 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.587444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-c447eb1a-fbde-48cb-b2a4-a10590f0aeef req-098bcc1c-3637-492c-901f-ab4a697daafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:46.589564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:46.589564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:53:46.598895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-c447eb1a-fbde-48cb-b2a4-a10590f0aeef req-098bcc1c-3637-492c-901f-ab4a697daafd service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.599715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-c447eb1a-fbde-48cb-b2a4-a10590f0aeef req-098bcc1c-3637-492c-901f-ab4a697daafd service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.616124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-c447eb1a-fbde-48cb-b2a4-a10590f0aeef req-098bcc1c-3637-492c-901f-ab4a697daafd service nova] Creating event network-changed:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:53:46.621981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-c447eb1a-fbde-48cb-b2a4-a10590f0aeef req-098bcc1c-3637-492c-901f-ab4a697daafd service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039432 Jan 24 16:53:46.622871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 328/640] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:46.650816 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:46.658796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-35b7c3af-f7fc-4235-b8be-abf9e623089c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.245201 Jan 24 16:53:46.659802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 313/641] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:46 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:46.900315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:46.900898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:46.907622 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.908064 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:46.908838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:46.909275 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.014706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.015348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] [instance: ffea6bfd-3cc1-438b-b7c3-29079c646252] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.022564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.023172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.023975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.024417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.038915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] HTTP exception thrown: Instance ffea6bfd-3cc1-438b-b7c3-29079c646252 could not be found. Jan 24 16:53:47.039510 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] Returning 404 to user: Instance ffea6bfd-3cc1-438b-b7c3-29079c646252 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:47.040336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-adf967b8-f58c-4167-a62f-a22cdd5d73e8 tempest-AttachVolumeNegativeTest-1027403693 tempest-AttachVolumeNegativeTest-1027403693-project] 10.222.0.117 "GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252" status: 404 len: 111 microversion: 2.1 time: 0.029355 Jan 24 16:53:47.040886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 314/642] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/ffea6bfd-3cc1-438b-b7c3-29079c646252 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:47.111766 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.121752 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-84e8495c-0ec5-42c5-bd5d-992367d53434 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1706 microversion: 2.1 time: 0.225462 Jan 24 16:53:47.122600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 329/643] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:46 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1706 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:47.141831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3e549922-fab9-429d-a454-6550cfb4258d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:47.152330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3e549922-fab9-429d-a454-6550cfb4258d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.152995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3e549922-fab9-429d-a454-6550cfb4258d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.188246 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3e549922-fab9-429d-a454-6550cfb4258d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Going to try to start instance {{(pid=127826) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 16:53:47.204105 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.204887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.213731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.214442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.215606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.216333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.246478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3e549922-fab9-429d-a454-6550cfb4258d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 202 len: 0 microversion: 2.1 time: 0.111182 Jan 24 16:53:47.247761 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 315/644] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:53:47 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:53:47.254182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.255547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.262760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.263231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.264784 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.265234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.279174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:53:47.390263 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cc209600-b0c6-48bd-aad1-d012b781f7f1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "DELETE /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 204 len: 0 microversion: 2.1 time: 0.189855 Jan 24 16:53:47.391592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 330/645] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:53:47 2022] DELETE /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 24 16:53:47.397540 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.398541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.405460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.406144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.407436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.408041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.574584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.584023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.585835 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.587729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d2d4f927-d3bd-4a06-a169-fb98ac9f4b97 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1724 microversion: 2.20 time: 0.338341 Jan 24 16:53:47.592196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 316/646] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:47.592747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.593455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.603185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.603747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.604649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.605184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.635417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.645985 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-93f651c3-5d19-4fad-836f-15fa641eb862 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.252813 Jan 24 16:53:47.647450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 331/647] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:47.652454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.653143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.659513 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.660760 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.661858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.662297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.890317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.898347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3e183c2c-cbcf-4146-9084-58723d774cd4 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1516 microversion: 2.1 time: 0.249537 Jan 24 16:53:47.908461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 332/648] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:47.908461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:47.908461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:47.911198 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.912140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.912965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:47.913408 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:47.977162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:47.992378 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a748c85b-9ab3-4b7b-89b2-7f16c200ec74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1715 microversion: 2.1 time: 0.402405 Jan 24 16:53:47.993174 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 317/649] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1715 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:48.071333 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:48.079191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3063b280-1e4a-4564-acb6-97a93f6b95aa tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.178167 Jan 24 16:53:48.079866 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 333/650] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:47 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:48.606812 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:48.607558 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:48.615460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.616251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.616934 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.617379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.663178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:48.663833 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:48.672813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.674827 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.676510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.679499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.772500 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:48.781711 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:48.783532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:48.784853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-19a25f7d-dc2a-4090-9eea-3f4dd8bc5299 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1727 microversion: 2.20 time: 0.181981 Jan 24 16:53:48.785418 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 318/651] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:48 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:48.804469 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b306cf-8953-42d5-b840-7b636424908d"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:48.805627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:48.812549 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.813005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.813921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.814263 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.827158 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:48.835926 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8fe1db51-c785-4849-a256-0761f938b644 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1571 microversion: 2.1 time: 0.176416 Jan 24 16:53:48.838818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 334/652] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:48 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:48.915773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:48.916308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:48.924148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.924604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:48.925397 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:48.925871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.092773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.100826 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2c262ea9-0d02-4989-a1c8-ebdadb8cc092 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1516 microversion: 2.1 time: 0.188713 Jan 24 16:53:49.101550 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 335/653] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:48 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:49.109215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.109215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:49.112653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.113086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.113986 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.114439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.126586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9edd4f99-5f04-4346-8f4a-42f226ecb91e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326729 Jan 24 16:53:49.127614 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 319/654] 10.222.0.117 () {62 vars in 1368 bytes} [Mon Jan 24 16:53:48 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:53:49.135810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.136420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:49.146710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.146710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.147089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.148005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.325478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.331378 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.333783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ac4d436b-7c40-4d13-a41c-baf7b4010796 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.205036 Jan 24 16:53:49.335446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 320/655] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:49.340233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5d1beedc-b178-4f47-a901-e349f5451f85 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1715 microversion: 2.1 time: 0.237720 Jan 24 16:53:49.341269 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 336/656] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1715 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:49.341816 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:49.342454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:49.349387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.349919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.350778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.351242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.449749 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-62954353-8f2b-4854-9de4-d7ab10354714 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action" status: 202 len: 0 microversion: 2.20 time: 0.113020 Jan 24 16:53:49.451172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 321/657] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:53:49 2022] POST /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:53:49.461144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.462012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:49.470169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.470625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.471456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.471894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.613362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.621809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.623342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:49.624501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f362322e-e8eb-4bed-8174-26cb30326f32 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1753 microversion: 2.20 time: 0.169677 Jan 24 16:53:49.626789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 337/658] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:53:49.674960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4c49765d-75d9-4937-bcf7-e7a607060403 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Action: 'create', calling method: .version_select at 0x7fba14fa0f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1743857219", "metadata": {"Type": "work"}}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:49.677163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4c49765d-75d9-4937-bcf7-e7a607060403 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.677958 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4c49765d-75d9-4937-bcf7-e7a607060403 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147738 Jan 24 16:53:49.678481 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 322/659] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:53:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:53:49.687433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fbd616e5-d054-4595-b0f3-9c8744a075b9 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Action: 'create', calling method: .version_select at 0x7fba14dee670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-78774798", "metadata": {"Type": "work"}}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:49.688949 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fbd616e5-d054-4595-b0f3-9c8744a075b9 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.689803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fbd616e5-d054-4595-b0f3-9c8744a075b9 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005969 Jan 24 16:53:49.690384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 338/660] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:53:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 24 16:53:49.700179 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9fd29f43-4ff0-4727-b021-92cdc5894e46 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Action: 'create', calling method: .version_select at 0x7fba14f613a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-453523135", "metadata": {"Type": "work"}}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:49.701364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9fd29f43-4ff0-4727-b021-92cdc5894e46 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.702279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9fd29f43-4ff0-4727-b021-92cdc5894e46 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006448 Jan 24 16:53:49.703012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 323/661] 10.222.0.117 () {60 vars in 1160 bytes} [Mon Jan 24 16:53:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:53:49.712155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e07c6786-118c-411d-962a-c678cd5cd104 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Calling method '.version_select at 0x7fba14e82670>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.739824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-e07c6786-118c-411d-962a-c678cd5cd104 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] HTTP exception thrown: Volume tempest-invalid-869848424 could not be found. Jan 24 16:53:49.740635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e07c6786-118c-411d-962a-c678cd5cd104 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 404 to user: Volume tempest-invalid-869848424 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.741474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e07c6786-118c-411d-962a-c678cd5cd104 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/tempest-invalid-869848424" status: 404 len: 98 microversion: 2.1 time: 0.033293 Jan 24 16:53:49.742018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 339/662] 10.222.0.117 () {58 vars in 1219 bytes} [Mon Jan 24 16:53:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-869848424 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 24 16:53:49.752132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b26efea2-5690-4ff2-bd7e-c75405d0f782 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003498 Jan 24 16:53:49.752620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 324/663] 10.222.0.117 () {58 vars in 1144 bytes} [Mon Jan 24 16:53:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 24 16:53:49.761262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-941e5b05-8d04-46e0-bcba-29f484280422 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003487 Jan 24 16:53:49.761761 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 340/664] 10.222.0.117 () {58 vars in 1141 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 24 16:53:49.770236 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-92558cbd-e23c-400d-877e-fa314fd3e0e5 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Calling method '.version_select at 0x7fba14f72940>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.796196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-92558cbd-e23c-400d-877e-fa314fd3e0e5 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] HTTP exception thrown: Volume 89d265a9-f8aa-4117-9947-3ee892126484 could not be found. Jan 24 16:53:49.796804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-92558cbd-e23c-400d-877e-fa314fd3e0e5 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 404 to user: Volume 89d265a9-f8aa-4117-9947-3ee892126484 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.797675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-92558cbd-e23c-400d-877e-fa314fd3e0e5 tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "DELETE /compute/v2.1/os-volumes/89d265a9-f8aa-4117-9947-3ee892126484" status: 404 len: 109 microversion: 2.1 time: 0.031446 Jan 24 16:53:49.798349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 325/665] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:53:49 2022] DELETE /compute/v2.1/os-volumes/89d265a9-f8aa-4117-9947-3ee892126484 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 16:53:49.807626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a15fe660-ccd8-41c5-8e78-52b5c688a93b tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Calling method '.version_select at 0x7fba15042b80>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.849266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-a15fe660-ccd8-41c5-8e78-52b5c688a93b tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] HTTP exception thrown: Volume a46abcd4-ed5e-4807-b5b8-513eae64b2ad could not be found. Jan 24 16:53:49.849980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a15fe660-ccd8-41c5-8e78-52b5c688a93b tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] Returning 404 to user: Volume a46abcd4-ed5e-4807-b5b8-513eae64b2ad could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:49.850913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a15fe660-ccd8-41c5-8e78-52b5c688a93b tempest-VolumesNegativeTest-1720271812 tempest-VolumesNegativeTest-1720271812-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/a46abcd4-ed5e-4807-b5b8-513eae64b2ad" status: 404 len: 109 microversion: 2.1 time: 0.046925 Jan 24 16:53:49.851998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 341/666] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/os-volumes/a46abcd4-ed5e-4807-b5b8-513eae64b2ad => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:49.864974 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:49.865603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:49.872237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.872688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:49.873694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:49.874138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.112427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:50.118685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.119428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.124464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a650edcb-7d59-41ce-a1ce-93e65b9bcbc0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1551 microversion: 2.1 time: 0.274985 Jan 24 16:53:50.125284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 326/667] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:49 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1551 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:50.127004 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.127639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.129024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.129775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.141912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.142403 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.149544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.150212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.155411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.155411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.297083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:50.306055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-90058bb6-bf76-4096-b92d-2152fba931d5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1516 microversion: 2.1 time: 0.191918 Jan 24 16:53:50.307069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 342/668] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:50 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:50.320268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] HTTP exception thrown: Cannot 'detach_volume' instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 while it is in vm_state rescued Jan 24 16:53:50.320918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Returning 409 to user: Cannot 'detach_volume' instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 while it is in vm_state rescued {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:50.321715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5b12b04e-328d-4310-b3f3-576e72e4e680 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments/96209495-92fa-4bc2-9a4e-327031b2c78b" status: 409 len: 152 microversion: 2.1 time: 0.183539 Jan 24 16:53:50.326181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 327/669] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:53:50 2022] DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments/96209495-92fa-4bc2-9a4e-327031b2c78b => generated 152 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 24 16:53:50.333104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:50.333693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.339829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.340278 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.341068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.341505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.351452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.352234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.365243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.366141 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.368341 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.372082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.442056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e132c377-95d9-424c-9053-d014e8742857 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action" status: 202 len: 0 microversion: 2.1 time: 0.112348 Jan 24 16:53:50.443525 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 343/670] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:53:50 2022] POST /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:53:50.450213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.452052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.466536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.467536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.468710 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.469299 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.824698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:50.834282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f9ae23c7-7195-4e2c-8534-8aaec7bb93a5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.488011 Jan 24 16:53:50.835102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 328/671] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:50 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:50.839837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.841221 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.848208 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.848912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.850037 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.850634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.864980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:50.878224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ce206054-244d-4eac-a109-99a898bf3a20 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1719 microversion: 2.1 time: 0.433263 Jan 24 16:53:50.891113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 344/672] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:50 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1719 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:50.896438 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:50.897306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:50.903572 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.904281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:50.905319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:50.905959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.019594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:51.040390 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9a088b80-eb12-44fe-85dd-86c6a1f30533 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1559 microversion: 2.1 time: 0.203998 Jan 24 16:53:51.041552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 329/673] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:50 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:51.062157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-5f3c8d2c-88e8-4eea-b99d-3e3624cbe00e req-d97db7dd-b52c-449d-a7b2-e81fa3da5465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb0d520-edd0-431c-983e-6560a5669811", "name": "network-vif-deleted", "tag": "31d086bf-d040-4a43-b6d6-e919fbc05b71"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:51.065346 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:51.065346 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:53:51.075249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5f3c8d2c-88e8-4eea-b99d-3e3624cbe00e req-d97db7dd-b52c-449d-a7b2-e81fa3da5465 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.076056 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5f3c8d2c-88e8-4eea-b99d-3e3624cbe00e req-d97db7dd-b52c-449d-a7b2-e81fa3da5465 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.090673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-5f3c8d2c-88e8-4eea-b99d-3e3624cbe00e req-d97db7dd-b52c-449d-a7b2-e81fa3da5465 service nova] Creating event network-vif-deleted:31d086bf-d040-4a43-b6d6-e919fbc05b71 for instance 0eb0d520-edd0-431c-983e-6560a5669811 on hv-cinder-82611 Jan 24 16:53:51.096318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-5f3c8d2c-88e8-4eea-b99d-3e3624cbe00e req-d97db7dd-b52c-449d-a7b2-e81fa3da5465 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053416 Jan 24 16:53:51.098637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 330/674] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:51.200489 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:51.213314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:51.216286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:51.217494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f17d8958-b6be-4db3-821f-4c896a1ff2c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1755 microversion: 2.20 time: 0.325331 Jan 24 16:53:51.219325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 345/675] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:50 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1755 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:51.324418 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:51.325395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:51.341930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.344595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.345970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.346433 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.401472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.402585 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.403278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lazy-loading 'fault' on Instance uuid 0eb0d520-edd0-431c-983e-6560a5669811 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:51.460514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:51.469069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1a1c31a0-0b39-4fe3-bbc5-f0aaf06badca tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 200 len: 1312 microversion: 2.1 time: 0.148560 Jan 24 16:53:51.470005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 331/676] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:51 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:51.851867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:51.852427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:51.872130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.872703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:51.873509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:51.874070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.057373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:52.058248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:52.066533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.067160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.068255 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.068865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.093703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:52.101577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c959c90a-cb13-421d-989e-ef2d6d1bdaa8 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.254646 Jan 24 16:53:52.113138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 346/677] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:51 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:52.212674 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:52.221664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b61aa782-5214-467e-b925-6efe9ff3cfb0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1559 microversion: 2.1 time: 0.167851 Jan 24 16:53:52.223124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 332/678] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:52 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:52.239487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:52.240233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:52.246227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.246911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.247889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.248489 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.465813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:52.475971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:52.478309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:52.479351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5e0fa2b5-79ee-4095-94b8-331f4be468c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.243880 Jan 24 16:53:52.479990 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 347/679] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:52 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:52.500048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:52.501022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 0eb0d520-edd0-431c-983e-6560a5669811] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:52.515806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.516535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.518790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.521874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.536335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] HTTP exception thrown: Instance 0eb0d520-edd0-431c-983e-6560a5669811 could not be found. Jan 24 16:53:52.536931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Returning 404 to user: Instance 0eb0d520-edd0-431c-983e-6560a5669811 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:53:52.537748 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-61182b12-f30a-4a72-a8d5-ae3828012399 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811" status: 404 len: 111 microversion: 2.1 time: 0.041528 Jan 24 16:53:52.538345 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 333/680] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:52 2022] GET /compute/v2.1/servers/0eb0d520-edd0-431c-983e-6560a5669811 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:53:52.676265 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-8a9ce36b-bdaa-4901-ba0f-cbcc00868d4f req-6ac49d77-b2fb-4ea4-a22b-edc33d690ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "name": "network-vif-plugged", "status": "completed", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:53:52.678689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:53:52.678689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:53:52.687615 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-8a9ce36b-bdaa-4901-ba0f-cbcc00868d4f req-6ac49d77-b2fb-4ea4-a22b-edc33d690ce8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:52.688787 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-8a9ce36b-bdaa-4901-ba0f-cbcc00868d4f req-6ac49d77-b2fb-4ea4-a22b-edc33d690ce8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:52.702709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-8a9ce36b-bdaa-4901-ba0f-cbcc00868d4f req-6ac49d77-b2fb-4ea4-a22b-edc33d690ce8 service nova] Creating event network-vif-plugged:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:53:52.719193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-8a9ce36b-bdaa-4901-ba0f-cbcc00868d4f req-6ac49d77-b2fb-4ea4-a22b-edc33d690ce8 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038250 Jan 24 16:53:52.722624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 348/681] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:53.118640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:53.119289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:53.125504 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.125973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.126744 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.127212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.244514 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:53.245317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:53.253592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.254391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.255494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.256183 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.281261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:53.289801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-34ab080d-475b-4c39-8994-457c0277fdb3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.174782 Jan 24 16:53:53.290373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 334/682] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:53 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:53.407714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:53.416250 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0a3a990b-c1dd-4d8b-a2d7-ad8bc6860e3d tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1565 microversion: 2.1 time: 0.176853 Jan 24 16:53:53.416816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 349/683] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:53 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:53.497259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:53.498389 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:53.500791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:53.500791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:53.508095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.508446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.508446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.517168 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.517369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.517369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.517528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.517528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.593288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lazy-loading 'services' on Instance uuid 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:53:53.650186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:53.658766 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:53.661526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:53.662685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-97f54cd2-69ff-42d6-b292-181e61309430 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.169250 Jan 24 16:53:53.663277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 335/684] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:53 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:53.667608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-70b33d57-14ef-4877-9f29-f10df2e505eb tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments/96209495-92fa-4bc2-9a4e-327031b2c78b" status: 202 len: 0 microversion: 2.1 time: 0.172819 Jan 24 16:53:53.668299 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 350/685] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:53:53 2022] DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments/96209495-92fa-4bc2-9a4e-327031b2c78b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:53:53.679251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:53.680248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:53.686616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.687216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.688144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:53.688589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:53.718115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cfd9a0d8-d3cb-48ce-aae9-afe2b2e0fd9e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Jan 24 16:53:53.718591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 336/686] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:53 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:54.306808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:54.307501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:54.313823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.314266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.315074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.315507 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.442359 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:54.449546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b05b088a-101d-44e6-9148-41632668b630 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.147245 Jan 24 16:53:54.450113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 351/687] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:54 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:54.680684 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:54.681273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:54.687833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.688291 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.689073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.689513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.729289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:54.730509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:54.736560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.737014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.737937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:54.738442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:54.767800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3ef8545f-42a3-4d71-8c38-7e81bb890457 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042183 Jan 24 16:53:54.768356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 352/688] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:54 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:54.826227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:54.835089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:54.836566 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:54.837735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-66d40e6a-326b-4f5c-a41e-2b2129012bf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.160866 Jan 24 16:53:54.838287 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 337/689] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:54 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:55.466363 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:55.466916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:55.474283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.474741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:55.475555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.475998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:55.602560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:55.609717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0d86b3d8-fafb-4656-80f5-a9fbb5699753 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.147121 Jan 24 16:53:55.610281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 353/690] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:55 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:53:55.779427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:55.780256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:55.787198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.787641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:55.788408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.788840 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:55.818005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8bac9d4f-4693-4db5-ac51-90267b3a1c70 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042219 Jan 24 16:53:55.818434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 338/691] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:55 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:55.855027 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:55.855680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:55.861740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.862201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:55.863664 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:55.863664 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:56.023951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:56.034049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:56.036317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:56.037503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fbb1dde4-d2a6-4580-b67c-7bc2dae18aa4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.186133 Jan 24 16:53:56.038068 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 354/692] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:55 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:56.626634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:56.627511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:56.634046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:56.634596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:56.639871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:56.640422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:56.836148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:56.837081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:56.850434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:56.850945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:56.851767 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:56.852212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:56.899066 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:56.904996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1c69d1d5-708b-4751-b207-0a81526527aa tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079013 Jan 24 16:53:56.906266 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 355/693] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:56 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:56.913300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-35c398b0-7fc1-458b-81d7-f99b61929cb5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.290170 Jan 24 16:53:56.913812 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 339/694] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:56 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:57.057683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:57.058799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:57.065806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.066360 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.067208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.067653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.245483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:57.255156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:57.256698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:57.257948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-86f8314e-671d-4da8-930f-5de4cd0ec64e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.204389 Jan 24 16:53:57.258725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 356/695] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:57 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:57.917044 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:57.917963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:57.925441 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.925441 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.931277 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:57.932505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:57.935576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.936032 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.939752 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.940203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.941488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:57.942007 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:57.968304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-caf6ffc1-8eb7-44c6-807b-d87832ae52c0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055089 Jan 24 16:53:57.969233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 340/696] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:57 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:53:58.088417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:58.103310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cd5799da-e087-431f-87b7-6873a6104587 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.175661 Jan 24 16:53:58.103905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 357/697] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:57 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:58.275798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:58.276396 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:58.282782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:58.283267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:58.286349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:58.286824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:58.419304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:58.428756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:58.430282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:58.431476 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0c0d8e02-9fa2-40a4-a2e2-094f5507f80e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.159400 Jan 24 16:53:58.432238 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 341/698] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:58 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:53:58.980955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:58.981873 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:58.988421 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:58.988875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:58.989814 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:58.990257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:59.024881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3e4a2b3c-4598-4914-985f-1d58d55b1097 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Jan 24 16:53:59.026172 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 358/699] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:53:58 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:53:59.120546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:59.121771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:59.127833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:59.128739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:59.129286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:59.129878 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:59.317425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:59.325484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b5ed2c6c-a271-44e2-bfa9-c95312afb997 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.208623 Jan 24 16:53:59.326337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 342/700] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:53:59 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:53:59.450689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:53:59.451459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:53:59.459786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:59.460318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:59.461756 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:53:59.462213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:53:59.520487 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 16:53:59.520698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 16:53:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 (ip 10.222.0.117) !!! Jan 24 16:53:59.620464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:59.629959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:59.631529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:53:59.632704 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-12692af9-ede5-42a3-808c-6d398cfbbaf3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.185737 Jan 24 16:53:59.633314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 359/701] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:53:59 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:00.037591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:00.038499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:00.044415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.044859 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.045633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.046065 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.075671 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-49e59aa6-143d-4b80-b9b3-a35b61da5852 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Jan 24 16:54:00.076251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 343/702] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:00 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:00.342979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:00.343837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:00.350837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.351289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.352095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.352534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.490811 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:00.498506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9015d1ae-25f3-4cb0-b297-0b91ffd41a1e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.159214 Jan 24 16:54:00.499111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 360/703] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:00 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:00.652068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:00.652680 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:00.659962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.660429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.661230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:00.661722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:00.799677 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:00.808837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:00.810330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:00.811523 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-35fcd0ff-4dcd-4f3d-a2b4-1b2c3a5cc4ac tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.163228 Jan 24 16:54:00.812083 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 344/704] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:00 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:01.087553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:01.088472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:01.094408 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.094903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.095691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.096131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.126058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-40f1bbce-2401-44b4-b010-de6de6d4aebd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042232 Jan 24 16:54:01.126854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 361/705] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:01 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:01.515811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:01.516716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:01.523131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.524312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.527894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.528436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.680769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:01.688509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b47a139d-21a6-4e24-9eb5-77bc2bc6cbaf tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.176399 Jan 24 16:54:01.689163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 345/706] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:01 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:01.832761 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:01.833384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:01.839705 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.840151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.840937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:01.841367 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:01.984520 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:02.000726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:02.003358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:02.005788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-615fe59e-2e9f-4c99-a81b-2c365d094583 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.176499 Jan 24 16:54:02.006294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 362/707] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:01 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:02.138121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:02.139259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:02.146096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:02.146627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:02.147514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:02.148019 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:02.185942 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6b482f48-25e6-468d-848c-31dbc7707d98 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051666 Jan 24 16:54:02.186513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 346/708] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:02 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:02.705223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:02.705751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:02.712331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:02.713015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:02.714016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:02.714806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:02.850853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:02.858309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c212fe97-4286-4d4b-b969-7686059a4d0c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.156806 Jan 24 16:54:02.867543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 363/709] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:02 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:03.025920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:03.026566 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:03.033620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.034076 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:03.035088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.035533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:03.182204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:03.192821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:03.194662 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:03.196165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-22b915a0-b6ce-4044-9812-8701a9cd2652 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.174397 Jan 24 16:54:03.207955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:03.207955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:03.207955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.208567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:03.209161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 347/710] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:03 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:03.209297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.209735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:03.242625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d49206d8-21dd-4e9e-9d99-b376c3555163 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Jan 24 16:54:03.243353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 364/711] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:03 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:03.874522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:03.875166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:03.881493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.881951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:03.882807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:03.883251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:04.023460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:04.031330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3f1f318a-8e4e-4a09-bf03-9aa8ef373513 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.160542 Jan 24 16:54:04.039509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 348/712] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:03 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:04.215500 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:04.216115 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:04.223197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:04.223646 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:04.224423 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:04.224862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:04.255391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:04.256576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:04.262645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:04.263124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:04.263916 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:04.264349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:04.295675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b8ffb8b1-a817-4ac6-a559-9ed32e2baf18 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Jan 24 16:54:04.296421 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 349/713] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:04 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:04.353714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:04.362132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:04.363652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:04.364792 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3e96b1b-e2c5-4011-bb9c-34d58e043101 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.152963 Jan 24 16:54:04.365347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 365/714] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:04 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:05.050067 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:05.051093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:05.057256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.057963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.058767 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.059209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.191693 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:05.198947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e705c3ac-724b-4a46-a845-54bd105d9c8e tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1362 microversion: 2.1 time: 0.153480 Jan 24 16:54:05.199514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 350/715] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:05 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:05.308657 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:05.309498 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:05.316538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.316992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.317791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.318234 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.347973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-733e2038-3bd5-45fe-9c2e-b8507b7ea71e tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Jan 24 16:54:05.348827 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 366/716] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:05 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:05.382111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:05.382711 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:05.388805 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.389251 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.390029 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:05.390474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:05.519080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:05.527325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:05.528831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:05.529982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b60bbe9e-1c1c-467a-a6d1-bbf00e3c572e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.151512 Jan 24 16:54:05.530541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 351/717] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:05 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:05.666780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-798428639", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "networks": [{"uuid": "2bfca7db-995d-4492-840e-71486008c43c"}]}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:05.718398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] validate_networks() for [('2bfca7db-995d-4492-840e-71486008c43c', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:54:06.069166 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:54:06.069601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:54:06.070128 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:54:06.070557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:54:06.071037 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:54:06.080091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.081156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.082049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.082492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.100077 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Getting quotas for project 772de9e75506447b87526f3e1f2cf34f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:54:06.104576 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Getting quotas for user 43bca89ee28143d780d350c37b3af65c and project 772de9e75506447b87526f3e1f2cf34f. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:54:06.115817 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:54:06.118240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:54:06.168707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f9f52616-e3ad-41fa-aa09-91c465df3779 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.505560 Jan 24 16:54:06.169347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 367/718] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:54:05 2022] POST /compute/v2.1/servers => generated 382 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:54:06.179165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cfb076ec-8825-4557-abc9-e0c23315377e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.179915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cfb076ec-8825-4557-abc9-e0c23315377e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.217263 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.218051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.225836 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.226348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.227430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.228755 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.237471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cfb076ec-8825-4557-abc9-e0c23315377e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.244449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cfb076ec-8825-4557-abc9-e0c23315377e tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1222 microversion: 2.1 time: 0.068940 Jan 24 16:54:06.245212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 352/719] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:06.360127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.362399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.368882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.369355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.370153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.370705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.373059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.382784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f554dfdd-fddd-4440-b56f-b18ec89bc604 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1551 microversion: 2.1 time: 0.169191 Jan 24 16:54:06.395910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 368/720] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1551 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:06.402489 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.403088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.406005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e6f650e2-0baf-4a0d-9a6b-2c614e3a605f tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049882 Jan 24 16:54:06.406590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 353/721] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:54:06.414211 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.414924 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.415794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.416230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.550065 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.551227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.558708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.559464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.560786 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.562088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.572100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.581452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-87e461fa-12e5-410d-a691-67f2a81d817a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1551 microversion: 2.1 time: 0.183733 Jan 24 16:54:06.582110 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 369/722] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1551 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:06.600240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.604096 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:06.604096 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:54:06.605439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.606109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Searching by: {'deleted': False, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f'} {{(pid=127827) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 24 16:54:06.613468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.613871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.614689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.615158 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.707552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.712491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.multi_cell_list [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127827) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 24 16:54:06.716604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.718209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.719606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-43dc1f49-be60-462e-82c2-2cbd7eb01cc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.175136 Jan 24 16:54:06.720183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 354/723] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:06.817804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a57582c0-fbfe-4311-b1c1-fa75c329cb02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.221928 Jan 24 16:54:06.818457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 370/724] 10.222.0.117 () {58 vars in 1129 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers => generated 345 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:06.828906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:06.829600 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:06.837062 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.837575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.838400 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:06.838845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:06.967118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:06.974299 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8adbbff7-1eb4-4124-b83c-316900cae5e9 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1551 microversion: 2.1 time: 0.149538 Jan 24 16:54:06.974887 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 355/725] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:06 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:07.263210 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:07.263834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:07.274043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:07.277382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:07.281527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:07.281991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:07.401049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:07.410342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-21caf7cb-1b8f-4095-9116-60e72f03d579 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1282 microversion: 2.1 time: 0.150034 Jan 24 16:54:07.412342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 371/726] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:07 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:07.738943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:07.739555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:07.748262 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:07.748733 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:07.749513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:07.750813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.185127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:08.194459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:08.195989 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:08.197148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d10d42b4-f3b2-47f5-8927-e7d83f8529ca tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.463568 Jan 24 16:54:08.197908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 356/727] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:07 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:08.428715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:08.429606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:08.446173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.446173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.446976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.447419 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.514242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bce33335-7884-448b-b6b4-3db806e6222b"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:08.515420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:08.522110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.522558 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.523584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.524021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.741342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:08.774922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b41613a4-6ac1-4d2e-9540-5e8d11a3bde5 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.350457 Jan 24 16:54:08.775733 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 372/728] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:08 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:08.785936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:08.786429 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:08.793325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.794030 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.795070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:08.795664 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:08.832342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-131ba63e-d000-49b5-91f2-359dd105e5c3 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319283 Jan 24 16:54:08.833993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 357/729] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:54:08 2022] POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:08.858523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:54:08.994807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3107368a-a59d-4de6-aca7-f73cc28035e1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 204 len: 0 microversion: 2.1 time: 0.212073 Jan 24 16:54:08.998923 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 373/730] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:54:08 2022] DELETE /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:54:09.008794 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:09.009800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:09.021661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.022121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.022966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.023572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.101556 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-6e5afe6d-2847-4439-90a4-04e54de5c3a0 req-1000e1bf-541a-447d-ab43-46e91102615e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ef53e4-801e-4a2d-a7ef-5fbece8b29bd", "tag": "7c867542-f820-45d0-8cc7-ba742f9557af"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:09.103249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:09.103249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:54:09.111035 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-6e5afe6d-2847-4439-90a4-04e54de5c3a0 req-1000e1bf-541a-447d-ab43-46e91102615e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.112260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-6e5afe6d-2847-4439-90a4-04e54de5c3a0 req-1000e1bf-541a-447d-ab43-46e91102615e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.123909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-6e5afe6d-2847-4439-90a4-04e54de5c3a0 req-1000e1bf-541a-447d-ab43-46e91102615e service nova] Creating event network-changed:7c867542-f820-45d0-8cc7-ba742f9557af for instance 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd on hv-cinder-82611 Jan 24 16:54:09.128895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-6e5afe6d-2847-4439-90a4-04e54de5c3a0 req-1000e1bf-541a-447d-ab43-46e91102615e service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037205 Jan 24 16:54:09.129848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 374/731] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:09.218620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:09.219673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:09.231787 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.232680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.233671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.234327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.244603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:09.254371 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-eda3249f-ed5f-4600-821d-e22c207de5a1 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1512 microversion: 2.1 time: 0.252911 Jan 24 16:54:09.255530 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 358/732] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:08 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:09.570944 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:09.579587 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:09.581943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:09.583434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a31433da-a075-4fbd-a505-439f074f30c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.369882 Jan 24 16:54:09.584082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 375/733] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:09 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:09.792673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:09.793283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:09.799619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.800071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.800876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:09.801310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:09.946467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:09.954989 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-681e148e-eb26-49d5-a764-8655b69093b6 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.165815 Jan 24 16:54:09.956633 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 359/734] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:09 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:10.271591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:10.272517 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:10.279019 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.279474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:10.280267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.280709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:10.452318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:10.460696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c1cabf68-e695-4fed-b701-864db1d72126 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1512 microversion: 2.1 time: 0.192740 Jan 24 16:54:10.461248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 376/735] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:10 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1512 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:10.601541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:10.602247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:10.608570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.609175 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:10.609955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.610388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:10.744795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:10.754004 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:10.755644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:10.756885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-80d7b5d4-a36c-4ee1-9b34-51aa7c39cb50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.159032 Jan 24 16:54:10.768579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 360/736] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:10 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:10.972570 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:10.973297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:10.979024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.979482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:10.980277 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:10.980722 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:11.133466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:11.144983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d453b9c3-bb4e-41dc-8f90-1b10b0a6d2cf tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.176596 Jan 24 16:54:11.145691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 377/737] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:10 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:11.476782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:11.477391 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:11.483166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:11.483608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:11.484375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:11.484808 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:11.618918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:11.626104 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cd2619b2-bc65-4880-8daf-58772c89d45a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1512 microversion: 2.1 time: 0.152984 Jan 24 16:54:11.626760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 361/738] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:11 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:11.775858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:11.776420 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:11.782707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:11.783267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:11.784108 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:11.784554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:11.916740 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:11.925737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:11.927252 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:11.928394 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-77e0b06a-9535-4d8a-9f19-3bcf5a3b9b15 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.156255 Jan 24 16:54:11.928955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 378/739] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:11 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:12.161355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:12.161968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:12.167985 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.168989 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.169194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.169628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.305903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:12.318182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-487160df-4aff-4913-a6cc-03f285e5f35c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.160529 Jan 24 16:54:12.319167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 362/740] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:12 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:12.643224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:12.643840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:12.649703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.650152 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.650980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.651424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.858741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:12.866978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f97b1840-f4fc-479e-9ec1-5c8617e714a0 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1512 microversion: 2.1 time: 0.227508 Jan 24 16:54:12.867680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 379/741] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:12 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:12.927053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-1260fbd4-daa7-439a-ab9e-45408a114730 req-d94ce416-4ce8-4980-a19e-55d4596945aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f33a394e-abd2-4047-a8a5-75c89566dbd2", "name": "network-vif-deleted", "tag": "5b46c1cc-6728-4897-8738-0827955179b2"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:12.928751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:12.928751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:12.937628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1260fbd4-daa7-439a-ab9e-45408a114730 req-d94ce416-4ce8-4980-a19e-55d4596945aa service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.938067 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1260fbd4-daa7-439a-ab9e-45408a114730 req-d94ce416-4ce8-4980-a19e-55d4596945aa service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.947195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:12.947827 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:12.949529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-1260fbd4-daa7-439a-ab9e-45408a114730 req-d94ce416-4ce8-4980-a19e-55d4596945aa service nova] Creating event network-vif-deleted:5b46c1cc-6728-4897-8738-0827955179b2 for instance f33a394e-abd2-4047-a8a5-75c89566dbd2 on hv-cinder-82611 Jan 24 16:54:12.953538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.953989 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:12.954404 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-1260fbd4-daa7-439a-ab9e-45408a114730 req-d94ce416-4ce8-4980-a19e-55d4596945aa service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031806 Jan 24 16:54:12.954868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:12.955185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 363/742] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:12.955825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:13.088886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:13.098340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:13.099817 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:13.100956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3e9ea72-3b11-4e19-aa08-583eacfe8e92 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.157436 Jan 24 16:54:13.101515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 380/743] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:12 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:13.335997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:13.336696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:13.343077 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:13.343525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:13.344300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:13.344760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:13.481664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:13.489000 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-77ae54ec-311c-41f2-9909-8093659bcfb3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.157018 Jan 24 16:54:13.489572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 364/744] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:13 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:13.884105 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:13.884819 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:13.891157 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:13.891676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:13.893058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:13.893578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:13.952212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:13.960288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-91e33edf-1e9e-4a98-8219-b5416e3a2983 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1470 microversion: 2.1 time: 0.080097 Jan 24 16:54:13.960866 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 381/745] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:13 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1470 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:14.119366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:14.119904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:14.126044 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.126489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:14.127324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.127755 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:14.259237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:14.268603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:14.270120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:14.271304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-486a32e4-c7cb-47f7-a0c5-f5cc9a63788b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.155712 Jan 24 16:54:14.271874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 365/746] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:14 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:14.505681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:14.506292 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:14.512209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.512657 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:14.513433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.513957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:14.639033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:14.646344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9997c64a-1145-4bd9-8f51-aa2ee4a0c4a3 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.144930 Jan 24 16:54:14.646939 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 382/747] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:14 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:14.977225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:14.977841 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:14.983743 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.984201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:14.984987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:14.985425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:15.042686 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:15.050596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7fee1298-e572-4538-8785-9b3244e8e790 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1297 microversion: 2.1 time: 0.077085 Jan 24 16:54:15.051195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 366/748] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:14 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1297 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:15.289002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:15.289696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:15.296274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:15.296725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:15.297509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:15.297942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:15.428114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:15.441468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:15.442991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:15.444199 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6a3b0a49-287b-489e-9341-0cd15d4192a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.158820 Jan 24 16:54:15.444744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 383/749] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:15 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:15.665085 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:15.665696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:15.671912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:15.672359 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:15.673129 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:15.673699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:15.812033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:15.821038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-650ea928-1f3e-4480-b249-146f7bb8c235 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.160341 Jan 24 16:54:15.821615 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 367/750] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:15 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:16.068395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:16.069005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:16.074770 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.075238 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.076013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.076452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.106346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.106820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.107273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lazy-loading 'fault' on Instance uuid f33a394e-abd2-4047-a8a5-75c89566dbd2 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:54:16.146841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:16.154385 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-49733753-a336-4e87-b00c-37c2ae452c97 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 200 len: 1316 microversion: 2.1 time: 0.090806 Jan 24 16:54:16.154977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 384/751] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:16 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 1316 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:16.461790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:16.462584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:16.468693 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.469236 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.470023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.471013 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.601555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:16.610228 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:16.612376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:16.613579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c50dc987-8931-4525-95a4-0b0aa73b4a1a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.155630 Jan 24 16:54:16.614127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 368/752] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:16 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:16.838069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:16.839285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:16.847148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.847719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.848563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:16.849090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:16.982669 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:16.990056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c01b0bb8-f756-4e62-b569-4b5ec37f3d6f tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.156465 Jan 24 16:54:16.990562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 385/753] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:16 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:17.170930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:17.171574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: f33a394e-abd2-4047-a8a5-75c89566dbd2] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:17.177827 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.178279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.179093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.179533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.193288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] HTTP exception thrown: Instance f33a394e-abd2-4047-a8a5-75c89566dbd2 could not be found. Jan 24 16:54:17.193867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Returning 404 to user: Instance f33a394e-abd2-4047-a8a5-75c89566dbd2 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:54:17.194663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d403e0fc-77b3-4b62-bbf2-f674a573b117 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2" status: 404 len: 111 microversion: 2.1 time: 0.027429 Jan 24 16:54:17.195226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 369/754] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:17 2022] GET /compute/v2.1/servers/f33a394e-abd2-4047-a8a5-75c89566dbd2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:54:17.202822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:17.203331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:17.209746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.210192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.210995 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.211424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.235175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:54:17.305424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b3808dc5-7eb9-4f96-aeb5-d68fb3ec804a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 204 len: 0 microversion: 2.1 time: 0.105988 Jan 24 16:54:17.306005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 386/755] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:54:17 2022] DELETE /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:54:17.314267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:17.315136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:17.320995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.321444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.322227 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.322654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.452077 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:17.460257 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-718249e6-f000-43cb-b402-3ed6c5a73bb5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.150081 Jan 24 16:54:17.460919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 370/756] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:17 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:17.462626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:17.463443 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:17.469443 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.469892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.471536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.471975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.604302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:17.612066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2d89f4e1-9b4c-4f3d-9e8d-a83856188c4b tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1597 microversion: 2.1 time: 0.153417 Jan 24 16:54:17.612631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 387/757] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:17 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1597 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:17.631530 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:17.632132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:17.638068 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.638515 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.639314 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:17.639741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:17.774056 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:17.782256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:17.784296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:17.785435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-30ed0984-6ff7-46f3-99a5-582e626990a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.157631 Jan 24 16:54:17.785993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 371/758] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:17 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:18.007132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:18.007996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:18.014400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.014979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:18.015839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.016286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:18.224565 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:18.233316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-18e86e5f-5df6-4844-8c61-dce4ae225170 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.229895 Jan 24 16:54:18.233981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 388/759] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:18 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:18.478558 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:18.479137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:18.485331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.486395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:18.487523 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.487970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:18.620622 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:18.629265 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0ae74af7-8ea8-4eda-add1-f168a18c2c0b tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.154397 Jan 24 16:54:18.629842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 372/760] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:18 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:18.803622 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:18.804235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:18.810475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.810973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:18.811767 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:18.812202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.039668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:19.047958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:19.050317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:19.051530 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e44ed611-9aa7-48d3-9d25-d9615f14c0cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.251672 Jan 24 16:54:19.052100 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 389/761] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:18 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:19.250802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:19.251885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:19.257605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:19.258055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.258967 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:19.259405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.400509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:19.408751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1435858f-726e-4c16-8f48-acf5a20214f2 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.161558 Jan 24 16:54:19.409343 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 373/762] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:19 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:19.646162 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:19.647141 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:19.653131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:19.653516 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.654308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:19.654772 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.762668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-ce9590b7-d488-483a-b27a-f2bcfac8fd95 req-be97f971-850d-414c-b341-f1f2c791752d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:19.772649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:19.772649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:19.784824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ce9590b7-d488-483a-b27a-f2bcfac8fd95 req-be97f971-850d-414c-b341-f1f2c791752d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:19.785700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ce9590b7-d488-483a-b27a-f2bcfac8fd95 req-be97f971-850d-414c-b341-f1f2c791752d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:19.801310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-ce9590b7-d488-483a-b27a-f2bcfac8fd95 req-be97f971-850d-414c-b341-f1f2c791752d service nova] Creating event network-changed:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:54:19.807956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-ce9590b7-d488-483a-b27a-f2bcfac8fd95 req-be97f971-850d-414c-b341-f1f2c791752d service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048326 Jan 24 16:54:19.809159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 374/763] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:19.825474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:19.834061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e452b0f8-926c-4d98-86f1-a93d8756aab2 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.191978 Jan 24 16:54:19.835512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 390/764] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:19 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:20.073615 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:20.074586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:20.086524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.087336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.088992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.089624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.292390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-bcbf8db1-8f24-4e61-8695-9113bece607a req-e218941e-1bec-4bda-b93a-c1c49ef93b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ef53e4-801e-4a2d-a7ef-5fbece8b29bd", "name": "network-vif-plugged", "status": "completed", "tag": "7c867542-f820-45d0-8cc7-ba742f9557af"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:20.296320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:20.296320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:54:20.316921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-bcbf8db1-8f24-4e61-8695-9113bece607a req-e218941e-1bec-4bda-b93a-c1c49ef93b8e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.317404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-bcbf8db1-8f24-4e61-8695-9113bece607a req-e218941e-1bec-4bda-b93a-c1c49ef93b8e service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.342136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-bcbf8db1-8f24-4e61-8695-9113bece607a req-e218941e-1bec-4bda-b93a-c1c49ef93b8e service nova] Creating event network-vif-plugged:7c867542-f820-45d0-8cc7-ba742f9557af for instance 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd on hv-cinder-82611 Jan 24 16:54:20.348133 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-bcbf8db1-8f24-4e61-8695-9113bece607a req-e218941e-1bec-4bda-b93a-c1c49ef93b8e service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060402 Jan 24 16:54:20.349050 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 391/765] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:20.364981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:20.377309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:20.381454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:20.384146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1cec7c61-ffc3-488f-9c5e-5fdde641e95a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.315853 Jan 24 16:54:20.390959 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 375/766] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:20 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:20.425894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:20.426625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:20.440881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.441257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.442239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.442686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.697244 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:20.706880 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5fba6837-536b-40bf-b204-fd469b4abdd1 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.284946 Jan 24 16:54:20.707911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 392/767] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:20 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:20.853184 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:20.853802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:20.861531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.862087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:20.863143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:20.863848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.057823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.066327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cbe91201-038e-4b4a-b510-e9820c9e0a09 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.217685 Jan 24 16:54:21.067249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 376/768] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:20 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:21.185845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-541277728"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:21.186447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:21.193862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.194943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.196036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.196632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.338781 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.network.security_group_api [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Adding security group 8a75eec8-0dcc-4941-a2aa-bc424b0564f6 to port 7a1e30e0-8581-4715-9b37-9a84fccf7f10 Jan 24 16:54:21.403012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:21.403612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:21.410143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.410599 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.411419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.411854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.552455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.560862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.562335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.563578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3c6386cf-472a-42c8-bdc3-7c3cf4071535 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.164377 Jan 24 16:54:21.571347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 377/769] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:21 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:21.687817 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0168ecd6-1a00-4dc0-8623-8dc40551171a tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.505272 Jan 24 16:54:21.692777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 393/770] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:54:21 2022] POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:54:21.697952 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:21.698573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:21.705253 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.705716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.706698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.707327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.723828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:21.724549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:21.731688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.732277 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.734163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.734739 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.901722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.905361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:21.913656 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-82a74e63-4194-40e1-8128-2069b853ec02 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1762 microversion: 2.1 time: 0.219265 Jan 24 16:54:21.914520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 378/771] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:21 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1762 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:21.921373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4180ce1f-fc10-44ad-a342-1537017e2f6a tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1322 microversion: 2.1 time: 0.202377 Jan 24 16:54:21.921961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 394/772] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:21 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:21.923258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-818e7f10-7a6e-4e74-abf6-92be43821499 req-b5a388a6-3182-4804-abd3-87397e40ce40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:21.925091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:21.925091 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:21.933170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-818e7f10-7a6e-4e74-abf6-92be43821499 req-b5a388a6-3182-4804-abd3-87397e40ce40 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:21.933883 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-818e7f10-7a6e-4e74-abf6-92be43821499 req-b5a388a6-3182-4804-abd3-87397e40ce40 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:21.945960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-818e7f10-7a6e-4e74-abf6-92be43821499 req-b5a388a6-3182-4804-abd3-87397e40ce40 service nova] Creating event network-changed:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:54:21.951308 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-818e7f10-7a6e-4e74-abf6-92be43821499 req-b5a388a6-3182-4804-abd3-87397e40ce40 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Jan 24 16:54:21.951909 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 379/773] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:22.084349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:22.085349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:22.091553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.092324 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.093355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.094012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.302330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:22.310927 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-48234c34-f56d-41a8-8a97-9c7ed3bc25cd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.230041 Jan 24 16:54:22.317390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 395/774] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:22 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:22.382142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-11661999-3681-4965-8003-12eff03bd470 req-7635399d-8179-4a91-b8bd-c466f88fc6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "name": "network-vif-plugged", "status": "completed", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:22.383710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:22.383710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:22.397831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-11661999-3681-4965-8003-12eff03bd470 req-7635399d-8179-4a91-b8bd-c466f88fc6ee service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.398573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-11661999-3681-4965-8003-12eff03bd470 req-7635399d-8179-4a91-b8bd-c466f88fc6ee service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.421842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-11661999-3681-4965-8003-12eff03bd470 req-7635399d-8179-4a91-b8bd-c466f88fc6ee service nova] Creating event network-vif-plugged:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:54:22.429018 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-11661999-3681-4965-8003-12eff03bd470 req-7635399d-8179-4a91-b8bd-c466f88fc6ee service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050743 Jan 24 16:54:22.430275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 380/775] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:22.588571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:22.589295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:22.595888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.596583 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.597628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.598348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.757748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:22.766330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:22.768832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:22.770052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fd88aadf-0371-406a-9e39-6d601f434fd3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.185406 Jan 24 16:54:22.770621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 396/776] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:22 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:22.946361 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:22.947015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:22.953140 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.953591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:22.955112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:22.955708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.087016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:23.095611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9b6ce68e-2c38-4a1d-8022-fd0c24baa679 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1510 microversion: 2.1 time: 0.152919 Jan 24 16:54:23.096222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 381/777] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:22 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:23.111673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bc01856-9722-4e11-8b51-d271587826fb", "device": "/dev/sdb"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:23.112846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:23.118801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.119260 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.120045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.120484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.328384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:23.328986 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:23.336025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.336473 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.337244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.337675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.472466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:23.480204 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c8b91dcb-b6db-44ba-9ff8-be46e4620202 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.155287 Jan 24 16:54:23.480880 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 382/778] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:23 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:23.787914 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:23.788514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:23.794359 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.794880 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.795651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:23.796079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:23.924388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:23.932898 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:23.934386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:23.935563 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e213965f-1e86-49e4-8ee3-745cc70747a3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.151329 Jan 24 16:54:23.936128 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 383/779] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:23 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:24.498109 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:24.498718 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:24.506297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:24.506768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:24.507556 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:24.507995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:24.639739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:24.647134 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-97338e34-c6e5-4aba-a557-fbc52723329a tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.152911 Jan 24 16:54:24.647710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 384/780] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:24 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:24.954866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:24.955546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:24.961680 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:24.962385 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:24.963235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:24.963674 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:25.096588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:25.104828 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:25.106331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:25.107513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-692480d4-02e2-48ef-bd62-0ad83d1ea7d2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.156605 Jan 24 16:54:25.108079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 385/781] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:24 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:25.663647 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:25.664273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:25.670516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:25.670999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:25.671788 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:25.672225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:25.803215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:25.810666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8f99a4d4-d3c2-4eaa-b4af-bce612d1d7b3 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.150738 Jan 24 16:54:25.811256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 386/782] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:25 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:26.057752 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e0a832ff-86d3-4bbd-bc06-82e1feb7fd49 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "POST /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.949651 Jan 24 16:54:26.058291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 397/783] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:54:23 2022] POST /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd/os-volume_attachments => generated 194 bytes in 2951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:26.129218 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:26.130867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:26.136870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:26.137304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:26.138098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:26.138540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:26.267079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:26.275293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:26.276797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:26.277942 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e2dc51bd-7329-4014-abe8-a0c004d69a13 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.153776 Jan 24 16:54:26.278514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 387/784] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:26 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:26.828678 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:26.829389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:26.835739 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:26.836170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:26.836941 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:26.837391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:26.971410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:26.978702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e8f59bd4-fbb0-4f5c-94a6-64c1f16461bd tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.154466 Jan 24 16:54:26.979366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 398/785] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:26 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:27.296499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:27.297109 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:27.303908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:27.304357 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:27.305143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:27.305584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:27.433957 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:27.442691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:27.444223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:27.445397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-03c04969-10c8-4e77-a2d1-8ee3867d23d4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.152635 Jan 24 16:54:27.445964 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 388/786] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:27 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:27.995983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:27.996596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:28.004222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:28.004708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:28.005507 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:28.005949 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:28.144553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:28.152430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c7835abc-4e56-4bdf-9fc6-f486e00d2fc4 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.160163 Jan 24 16:54:28.153002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 399/787] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:27 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:28.464260 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:28.464940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:28.471687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:28.472135 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:28.472916 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:28.473349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:28.612849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:28.621059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:28.622552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:28.623725 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-402728e1-95ab-40ca-bbd2-14bb8ab7a4cd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.163564 Jan 24 16:54:28.624283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 389/788] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:28 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:54:29.169087 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:29.169713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:29.176148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:29.176592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:29.177361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:29.177794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:29.311814 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:29.319607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-41f1ea83-fb89-4fb4-b858-1984ab52c578 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.154165 Jan 24 16:54:29.320165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 400/789] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:29 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:29.642244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:29.642884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:29.649208 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:29.649654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:29.650429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:29.650918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:29.778925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:29.787016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:29.788507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:29.789643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a2c9fb90-45e0-40c5-a5af-1f35f746928f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.151569 Jan 24 16:54:29.790203 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 390/790] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:29 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:30.335970 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:30.336578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:30.342913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:30.343362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:30.344014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:30.345631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:30.471011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:30.478218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f71c8787-a24b-4a0f-a2c2-8794a96934d5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.145820 Jan 24 16:54:30.478810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 401/791] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:30 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:30.807235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:30.807842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:30.815094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:30.815548 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:30.816324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:30.816760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:30.949349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:30.958183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:30.959725 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:30.960904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f5e802ac-8dcc-4142-ba88-adc7f13cd460 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1811 microversion: 2.20 time: 0.157586 Jan 24 16:54:30.961464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 391/792] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:30 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:31.494906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:31.495539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:31.501779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:31.502222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:31.503012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:31.503444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:31.637674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:31.645093 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-40de6d69-3a24-4314-bbe5-ca81fec1dd4c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.153815 Jan 24 16:54:31.645660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 402/793] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:31 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:31.979022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:31.979622 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:31.986131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:31.986572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:31.987378 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:31.987817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:32.120624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:32.129979 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:32.131631 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:32.132812 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-81791e25-f563-4e9a-833f-786c8b9423c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1798 microversion: 2.20 time: 0.157461 Jan 24 16:54:32.133665 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 392/794] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:54:31 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1798 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:54:32.661364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:32.661903 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:32.668209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:32.668662 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:32.669442 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:32.669889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:32.802387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:32.809884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-927c2e44-0984-4f1f-8695-c9f715d469ed tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.152417 Jan 24 16:54:32.810455 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 403/795] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:32 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:33.827099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:33.827746 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:33.834095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:33.834544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:33.835366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:33.835801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:33.965501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:33.973747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-aa8b3dae-30a4-40c1-9a7d-58bc83c11d68 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.150241 Jan 24 16:54:33.974325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 393/796] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:33 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:34.990923 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:34.991534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:34.997864 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:34.998320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:34.999128 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:34.999569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:35.128782 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:35.136153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-28ae853b-e100-42e3-bef3-e3569642809c tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.148869 Jan 24 16:54:35.136729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 404/797] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:34 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:36.153643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:36.154259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:36.160813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:36.161270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:36.162058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:36.162500 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:36.296475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:36.304779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ea3e358f-7bb3-4658-a2bd-07426bd071c5 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.154858 Jan 24 16:54:36.305342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 394/798] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:36 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:37.323409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:37.324022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:37.331050 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:37.331533 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:37.332325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:37.332762 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:37.488971 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:37.496174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1702007f-c097-4fee-9a74-d810d1cee9c8 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.176971 Jan 24 16:54:37.496742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 405/799] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:37 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:38.513231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:38.513770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:38.520280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:38.520734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:38.521520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:38.521955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:38.659521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:38.666914 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-33982ba1-4bc9-4561-9734-062cfe14fdde tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.157447 Jan 24 16:54:38.667489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 395/800] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:38 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:39.682655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:39.683390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:39.690374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:39.690837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:39.691608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:39.692039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:39.824328 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:39.831554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f009aac8-68fe-4481-80cd-e605c3824d01 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.152826 Jan 24 16:54:39.832121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 406/801] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:39 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:40.830607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-12fe2ebc-0a13-45ae-9a98-888cb6355052 req-ded8a7a6-86b6-429a-90ca-973712defd70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5", "name": "network-vif-unplugged", "status": "completed", "tag": "89e6e811-c42c-4807-b037-54df679556fd"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:40.832862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:40.832862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:40.840488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-12fe2ebc-0a13-45ae-9a98-888cb6355052 req-ded8a7a6-86b6-429a-90ca-973712defd70 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:40.840940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-12fe2ebc-0a13-45ae-9a98-888cb6355052 req-ded8a7a6-86b6-429a-90ca-973712defd70 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:40.848683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:40.849319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:40.858198 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:40.858651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:40.859494 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:40.859924 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:40.866354 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-12fe2ebc-0a13-45ae-9a98-888cb6355052 req-ded8a7a6-86b6-429a-90ca-973712defd70 service nova] Creating event network-vif-unplugged:89e6e811-c42c-4807-b037-54df679556fd for instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 on hv-cinder-82611 Jan 24 16:54:40.882589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-12fe2ebc-0a13-45ae-9a98-888cb6355052 req-ded8a7a6-86b6-429a-90ca-973712defd70 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049184 Jan 24 16:54:40.883292 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 396/802] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:41.299212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86b459cc02f4f38a2ced5f25972535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed4ca830bf54f2493c46fb3cf3fbbc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:41.306807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ebb22b91-d836-402b-bcf9-92111f5b6254 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 200 len: 1525 microversion: 2.1 time: 0.461777 Jan 24 16:54:41.307382 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 407/803] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:40 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 1525 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:41.397298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-5448bbbc-0dfc-4e44-a5b8-be7e9f9ce781 req-70501333-3b0e-4f7e-9bc4-635aca425c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5", "name": "network-vif-deleted", "tag": "89e6e811-c42c-4807-b037-54df679556fd"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:41.398798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:41.398798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:41.405759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5448bbbc-0dfc-4e44-a5b8-be7e9f9ce781 req-70501333-3b0e-4f7e-9bc4-635aca425c63 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:41.406205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5448bbbc-0dfc-4e44-a5b8-be7e9f9ce781 req-70501333-3b0e-4f7e-9bc4-635aca425c63 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:41.416848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-5448bbbc-0dfc-4e44-a5b8-be7e9f9ce781 req-70501333-3b0e-4f7e-9bc4-635aca425c63 service nova] Creating event network-vif-deleted:89e6e811-c42c-4807-b037-54df679556fd for instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 on hv-cinder-82611 Jan 24 16:54:41.421590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-5448bbbc-0dfc-4e44-a5b8-be7e9f9ce781 req-70501333-3b0e-4f7e-9bc4-635aca425c63 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028191 Jan 24 16:54:41.422194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 397/804] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:42.324340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:42.324947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] [instance: 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:42.331506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:42.331929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:42.332696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:42.333132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:42.346023 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] HTTP exception thrown: Instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 could not be found. Jan 24 16:54:42.346592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] Returning 404 to user: Instance 44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:54:42.347432 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dd0c7280-2a19-4d6b-9430-3cce354d5e84 tempest-ServerRescueNegativeTestJSON-833003131 tempest-ServerRescueNegativeTestJSON-833003131-project] 10.222.0.117 "GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5" status: 404 len: 111 microversion: 2.1 time: 0.026798 Jan 24 16:54:42.347942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 408/805] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:42 2022] GET /compute/v2.1/servers/44f0d783-e4af-4ad1-bc5d-4f3c412e8bb5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:54:47.759589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-be86558c-90b7-4510-901f-de3df9c4a39e tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14e0b9d0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:47.806787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-be86558c-90b7-4510-901f-de3df9c4a39e tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/47560d79-3536-4b67-b295-2365c8e8a9ce" status: 200 len: 351 microversion: 2.1 time: 0.051388 Jan 24 16:54:47.814108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 398/806] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:54:47 2022] GET /compute/v2.1/os-volumes/47560d79-3536-4b67-b295-2365c8e8a9ce => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:49.131191 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c28f49d2-3255-4c86-b6a1-e935bde13f33 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14d00e50>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:49.179748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c28f49d2-3255-4c86-b6a1-e935bde13f33 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/734a95e5-4644-4014-b95e-3163f2d2a388" status: 200 len: 351 microversion: 2.1 time: 0.052274 Jan 24 16:54:49.180709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 409/807] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:54:49 2022] GET /compute/v2.1/os-volumes/734a95e5-4644-4014-b95e-3163f2d2a388 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:49.451282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:49.451906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:49.459564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:49.460024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:49.460842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:49.461468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:49.551014 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lazy-loading 'services' on Instance uuid 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:54:49.624186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-66354b3a-e7d4-4fb0-be2b-3077be1ee27c tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "DELETE /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd/os-volume_attachments/8bc01856-9722-4e11-8b51-d271587826fb" status: 202 len: 0 microversion: 2.1 time: 0.177079 Jan 24 16:54:49.624817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 399/808] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:54:49 2022] DELETE /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd/os-volume_attachments/8bc01856-9722-4e11-8b51-d271587826fb => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:54:50.486058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ef515fbf-613c-4e5c-8d41-392d103ac313 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14deeaf0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.533274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ef515fbf-613c-4e5c-8d41-392d103ac313 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/cd11d582-816f-44d7-9269-0170f4089d46" status: 200 len: 350 microversion: 2.1 time: 0.051346 Jan 24 16:54:50.533843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 410/809] 10.222.0.117 () {58 vars in 1249 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes/cd11d582-816f-44d7-9269-0170f4089d46 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:50.545525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-69c68738-1a67-458d-b53d-a4ff6d5da043 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14de9af0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.628320 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-69c68738-1a67-458d-b53d-a4ff6d5da043 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087179 Jan 24 16:54:50.628900 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 400/810] 10.222.0.117 () {58 vars in 1138 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:50.641473 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c2ee5b3-6fed-42fe-afe7-951fabeab6fa tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14cead30>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.720791 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c2ee5b3-6fed-42fe-afe7-951fabeab6fa tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083864 Jan 24 16:54:50.721369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 411/811] 10.222.0.117 () {58 vars in 1153 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:50.729655 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.730274 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:50.732253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-77068d00-8080-4025-b68d-10b2740bcdf1 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14eb5b80>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.737205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:50.737743 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:50.738628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:50.739162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:50.763540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:54:50.810295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-77068d00-8080-4025-b68d-10b2740bcdf1 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.081290 Jan 24 16:54:50.810897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 412/812] 10.222.0.117 () {58 vars in 1138 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:50.821743 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-82475a02-8f2f-4190-a8ca-49b6c5ef8a58 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14dda700>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.847429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-63205ee1-dfcd-4c7e-8abf-19ec10514866 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "DELETE /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 204 len: 0 microversion: 2.1 time: 0.121180 Jan 24 16:54:50.848297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 401/813] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:54:50 2022] DELETE /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:54:50.856229 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.856922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:50.863024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:50.863456 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:50.864230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:50.864734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:50.907631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-82475a02-8f2f-4190-a8ca-49b6c5ef8a58 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089376 Jan 24 16:54:50.908220 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 413/814] 10.222.0.117 () {58 vars in 1171 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:50.919478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-45c4a666-94db-4ef0-a47a-b1b7cfcbabf9 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14eacdc0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:50.995524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:50.998738 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-45c4a666-94db-4ef0-a47a-b1b7cfcbabf9 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082805 Jan 24 16:54:50.999900 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 414/815] 10.222.0.117 () {58 vars in 1174 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:54:51.003824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b936aa6f-44a2-4da5-9ccd-17525e7c4843 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1516 microversion: 2.1 time: 0.151339 Jan 24 16:54:51.004397 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 402/816] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:50 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:51.011895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e1a5cfbe-9bd7-4457-8e12-82fc2514968e tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14c981f0>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:51.090568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e1a5cfbe-9bd7-4457-8e12-82fc2514968e tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082046 Jan 24 16:54:51.091180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 415/817] 10.222.0.117 () {58 vars in 1159 bytes} [Mon Jan 24 16:54:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:54:51.102431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0bca528a-6715-4f23-9999-3093edf72430 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14d86160>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:51.181744 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0bca528a-6715-4f23-9999-3093edf72430 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082787 Jan 24 16:54:51.182313 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 403/818] 10.222.0.117 () {58 vars in 1192 bytes} [Mon Jan 24 16:54:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:51.194230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9eb1c5c8-c697-4c2b-81f7-824c4fc60eb3 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] Calling method '.version_select at 0x7fba14d00c10>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:51.271471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9eb1c5c8-c697-4c2b-81f7-824c4fc60eb3 tempest-VolumesTestJSON-499095089 tempest-VolumesTestJSON-499095089-project] 10.222.0.117 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.080724 Jan 24 16:54:51.272078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 416/819] 10.222.0.117 () {58 vars in 1159 bytes} [Mon Jan 24 16:54:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:52.021002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:52.021679 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:52.030817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:52.031202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:52.031988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:52.032431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:52.163119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:52.170386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ac827fec-6dda-41e7-9c20-40ed3c1de2ad tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1516 microversion: 2.1 time: 0.153110 Jan 24 16:54:52.171284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 404/820] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:52 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:53.188003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:53.188623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:53.194916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:53.195374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:53.196169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:53.196610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:53.360713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43bca89ee28143d780d350c37b3af65c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772de9e75506447b87526f3e1f2cf34f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:54:53.368364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-546a205d-5502-4273-ba32-0930ac476946 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 200 len: 1516 microversion: 2.1 time: 0.185115 Jan 24 16:54:53.368950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 417/821] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:53 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 1516 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:54:53.808611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-d3bbb69f-d441-471c-8350-1368a003f4c7 req-c754be68-4a79-4749-ae9f-9f5bdbe54618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ef53e4-801e-4a2d-a7ef-5fbece8b29bd", "name": "network-vif-deleted", "tag": "7c867542-f820-45d0-8cc7-ba742f9557af"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:54:53.810087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:54:53.810087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:54:53.832233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d3bbb69f-d441-471c-8350-1368a003f4c7 req-c754be68-4a79-4749-ae9f-9f5bdbe54618 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:53.832743 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d3bbb69f-d441-471c-8350-1368a003f4c7 req-c754be68-4a79-4749-ae9f-9f5bdbe54618 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:53.848312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-d3bbb69f-d441-471c-8350-1368a003f4c7 req-c754be68-4a79-4749-ae9f-9f5bdbe54618 service nova] Creating event network-vif-deleted:7c867542-f820-45d0-8cc7-ba742f9557af for instance 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd on hv-cinder-82611 Jan 24 16:54:53.854793 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-d3bbb69f-d441-471c-8350-1368a003f4c7 req-c754be68-4a79-4749-ae9f-9f5bdbe54618 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050121 Jan 24 16:54:53.855632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 405/822] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:54:54.385279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:54:54.385898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] [instance: 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:54:54.392874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:54.393327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:54.394127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:54:54.394570 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:54:54.409047 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] HTTP exception thrown: Instance 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd could not be found. Jan 24 16:54:54.410122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] Returning 404 to user: Instance 99ef53e4-801e-4a2d-a7ef-5fbece8b29bd could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:54:54.411258 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8d110d50-67be-4b10-b885-64dc1e9fd603 tempest-VolumesSnapshotTestJSON-1097736181 tempest-VolumesSnapshotTestJSON-1097736181-project] 10.222.0.117 "GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd" status: 404 len: 111 microversion: 2.1 time: 0.029669 Jan 24 16:54:54.411928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 418/823] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:54:54 2022] GET /compute/v2.1/servers/99ef53e4-801e-4a2d-a7ef-5fbece8b29bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:55:01.426435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:01.427114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:01.433256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:01.433699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:01.434496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:01.434958 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:01.518112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lazy-loading 'services' on Instance uuid 10c5d45c-1da7-4563-ac75-ae5d1dc892ec {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:55:01.613832 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4d03d11f-1f46-49cb-9895-fc90c1bd307f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments/e939ecc8-9434-48e4-b6b0-1cb0ecbf1521" status: 202 len: 0 microversion: 2.1 time: 0.191747 Jan 24 16:55:01.615185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 406/824] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:55:01 2022] DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments/e939ecc8-9434-48e4-b6b0-1cb0ecbf1521 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:55:02.738357 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dba2fc6d-6c8c-41ce-88a9-3232297e50bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:02.761384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dba2fc6d-6c8c-41ce-88a9-3232297e50bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:02.761844 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dba2fc6d-6c8c-41ce-88a9-3232297e50bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:02.833486 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dba2fc6d-6c8c-41ce-88a9-3232297e50bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Going to try to stop instance {{(pid=127827) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 24 16:55:02.885955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dba2fc6d-6c8c-41ce-88a9-3232297e50bd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 202 len: 0 microversion: 2.1 time: 0.149596 Jan 24 16:55:02.887349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 419/825] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:55:02 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:55:02.907653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:02.914464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:02.929875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:02.930333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:02.931151 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:02.932325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:03.119056 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:03.126885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e61fb70b-8579-4d15-991a-35df62134bdc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.234449 Jan 24 16:55:03.127966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 407/826] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:02 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:04.146982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:04.147862 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:04.153988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:04.155424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:04.156598 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:04.157058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:04.469681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:04.473642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-679b4e6b-8970-49b4-8fe9-eddc4ff6c43d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.332163 Jan 24 16:55:04.474240 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 420/827] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:04 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:05.489956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:05.490501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:05.496579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:05.497014 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:05.497798 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:05.498245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:05.630014 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:05.637415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-815cb6e3-9991-4469-ba25-522d16fdccdf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.151382 Jan 24 16:55:05.637999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 408/828] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:05 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:06.654577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:06.655847 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:06.662113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:06.662563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:06.663374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:06.663815 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:06.793469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:06.801537 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4af85480-da45-4994-839e-6a11d4b3c09c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.150656 Jan 24 16:55:06.802356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 421/829] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:06 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:07.818910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:07.819512 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:07.825773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:07.826189 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:07.826980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:07.827620 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:07.983120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:07.991729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-32a19352-315d-46bb-bca9-8b72275845d1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.176376 Jan 24 16:55:07.992304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 409/830] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:07 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:09.011727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:09.011727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:09.017738 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:09.018286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:09.019186 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:09.019700 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:09.158922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:09.166445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e077a5b3-96b2-4ad0-9614-5d27773fde2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.161146 Jan 24 16:55:09.167031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 422/831] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:09 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:10.185394 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:10.186583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:10.192661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:10.193108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:10.193908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:10.194340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:10.352791 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:10.360781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a24975ff-3134-4894-a55b-815579d4c507 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.178967 Jan 24 16:55:10.361516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 410/832] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:10 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:11.381344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:11.382063 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:11.388511 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:11.388962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:11.389800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:11.390354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:11.520257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:11.527763 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ff936fff-6b7f-4082-ab4c-733237fd0aa5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.150147 Jan 24 16:55:11.528431 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 423/833] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:11 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:12.545159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:12.545768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:12.552592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:12.553043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:12.553834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:12.554544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:12.688780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:12.696739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4c0f27c7-b475-4168-97a0-21339bddf8fc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.155264 Jan 24 16:55:12.697318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 411/834] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:12 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:13.714536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:13.715418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:13.723187 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:13.723799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:13.724942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:13.725431 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:13.870114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:13.878129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3fcffc35-e8f3-41ce-8706-cf0c7514b79d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.167793 Jan 24 16:55:13.878723 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 424/835] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:13 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:14.269770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:14.270817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:14.277092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.277542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:14.278318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.278771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:14.359390 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-413b8651-6703-464b-aa2b-5a8a5a3d4d5f tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.093697 Jan 24 16:55:14.363305 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 412/836] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:55:14 2022] POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:55:14.368617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:14.369235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:14.375217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.376303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:14.377000 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.381883 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:14.627052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:14.634843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f67f35ee-e4df-4743-8f44-ef101905af26 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1754 microversion: 2.1 time: 0.269918 Jan 24 16:55:14.635405 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 425/837] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:14 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1754 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:14.896771 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:14.897484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:14.903545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.904207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:14.905196 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:14.905636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:15.048971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:15.056520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-de1c23c5-aef3-4411-bba7-8eb14152bf3b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.163802 Jan 24 16:55:15.057097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 413/838] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:14 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:15.653233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:15.654054 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:15.662114 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:15.662651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:15.663674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:15.664127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:15.818042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:15.826586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-736fbb5c-98fb-4073-8c56-53612280b4b6 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.177256 Jan 24 16:55:15.827401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 426/839] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:15 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:16.073918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:16.074528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:16.081304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:16.081753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:16.082531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:16.082999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:16.216242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:16.223568 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fa09f162-d2e9-48ed-840f-5b9bd7847f1b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.153393 Jan 24 16:55:16.224141 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 414/840] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:16 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:55:16.845821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:16.846439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:16.852950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:16.853564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:16.854377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:16.854844 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:17.146626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:17.158736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8d77be24-33f2-4ae9-a265-e3176d38ad53 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.317038 Jan 24 16:55:17.159375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 427/841] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:16 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:17.242744 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:17.244770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:17.253300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:17.253764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:17.254564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:17.255030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:17.425567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:17.438454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7cba4fbd-5967-419a-acc1-d2df23e31160 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1683 microversion: 2.1 time: 0.200335 Jan 24 16:55:17.440536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 415/842] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:17 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1683 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:18.176314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:18.177000 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:18.183922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.184453 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.185310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.185812 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.401376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:18.413099 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dce703cc-9a22-4f26-95c4-e4d3ace311ec tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.240836 Jan 24 16:55:18.414254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 428/843] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:18 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:18.457787 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:18.458403 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:18.465069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.466141 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.467594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.469554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.689454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:18.698534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a977c033-6ed7-4deb-b666-2fc13ee7a989 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1660 microversion: 2.1 time: 0.245123 Jan 24 16:55:18.700036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 416/844] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:18 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1660 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:18.716601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f918544f-7fba-4fd8-a159-8153c7bcfab5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:18.724121 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f918544f-7fba-4fd8-a159-8153c7bcfab5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.725751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f918544f-7fba-4fd8-a159-8153c7bcfab5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.767597 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f918544f-7fba-4fd8-a159-8153c7bcfab5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Going to try to start instance {{(pid=127827) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 24 16:55:18.823013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f918544f-7fba-4fd8-a159-8153c7bcfab5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action" status: 202 len: 0 microversion: 2.1 time: 0.109675 Jan 24 16:55:18.823970 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 429/845] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:55:18 2022] POST /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:55:18.831993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:18.832696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:18.846529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.847025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:18.847834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:18.848275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:19.050964 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:19.059296 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7c3d5baa-44c6-4d02-a864-d2566a99710d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1669 microversion: 2.1 time: 0.231097 Jan 24 16:55:19.066946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 417/846] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:18 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:19.431345 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:19.432871 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:19.440307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:19.441059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:19.442044 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:19.442668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:20.041566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:20.056276 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-edd937ed-d61f-4393-bf43-8abb5a7c1879 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.629975 Jan 24 16:55:20.066712 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 430/847] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:19 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:20.082776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:20.083145 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:20.089872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:20.090555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:20.092916 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:20.093701 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:20.361905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:20.369608 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a125af36-5a47-42a4-b2f9-d4e33a5ab278 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1669 microversion: 2.1 time: 0.291658 Jan 24 16:55:20.382630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 418/848] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:20 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:21.073381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:21.074048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:21.083853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:21.085126 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:21.087290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:21.088253 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:21.389293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:21.391121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:21.398034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:21.398807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:21.399777 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:21.400375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:21.606786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:21.616653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f0379a33-6bcc-43ad-b0a6-303a786487bc tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.546933 Jan 24 16:55:21.617374 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 431/849] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:21 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:21.753570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:21.764059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-223dad79-fc84-4ac6-b0e2-61a0e462348a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1673 microversion: 2.1 time: 0.378212 Jan 24 16:55:21.766350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 419/850] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:21 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1673 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:22.635416 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:22.636090 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:22.642933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:22.643378 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:22.644171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:22.644869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:22.996773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:23.009953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c54d1b92-5e9d-4e8c-ba3a-9ef665abffd5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.380268 Jan 24 16:55:23.010863 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 432/851] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:22 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:24.033573 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:24.035384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:24.036375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:24.036813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:24.047181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.047645 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.048462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.048910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.049379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.050047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.051087 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.052312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.149223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f3ea5019-1170-4518-83bc-389d4744a18f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments/57b306cf-8953-42d5-b840-7b636424908d" status: 200 len: 194 microversion: 2.20 time: 0.129511 Jan 24 16:55:24.150319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 420/852] 10.222.0.117 () {60 vars in 1458 bytes} [Mon Jan 24 16:55:24 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments/57b306cf-8953-42d5-b840-7b636424908d => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:55:24.261220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:24.261717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:24.279258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.279661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.280467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.281098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.382281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:24.391805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fe372539-ce68-46d0-a50f-7a74b9643d7c tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.364925 Jan 24 16:55:24.399086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 433/853] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:24 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:24.628112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lazy-loading 'services' on Instance uuid fb3e6d05-f352-44f0-88b9-77cf52d979a3 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:55:24.725220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-98fa9a3c-d3c9-40c2-a441-a59cbe5c59a0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments/57b306cf-8953-42d5-b840-7b636424908d" status: 202 len: 0 microversion: 2.20 time: 0.469818 Jan 24 16:55:24.729325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 421/854] 10.222.0.117 () {60 vars in 1461 bytes} [Mon Jan 24 16:55:24 2022] DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments/57b306cf-8953-42d5-b840-7b636424908d => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:55:24.735071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:24.736280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:24.744573 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.748193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.758682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:24.759355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:24.834006 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fcfecfde-c702-4490-bf5e-acf8f9672611 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103603 Jan 24 16:55:24.834801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 434/855] 10.222.0.117 () {60 vars in 1347 bytes} [Mon Jan 24 16:55:24 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:55:25.410379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:25.411121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:25.423275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:25.424130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:25.425905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:25.427210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:25.850420 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:25.852256 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:25.861127 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:25.861836 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:25.863596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:25.864233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:25.928973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-752783e9-e517-4010-88c0-cfdb8ed82cfa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082870 Jan 24 16:55:25.930350 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 435/856] 10.222.0.117 () {60 vars in 1347 bytes} [Mon Jan 24 16:55:25 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:55:25.959503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:25.978521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d94817fb-2666-4eba-bcfc-060e7546a9cd tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.573302 Jan 24 16:55:25.979324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 422/857] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:25 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:26.941665 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:26.942602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:26.956916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:26.957850 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:26.958892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:26.959518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:26.996033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:26.996660 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:27.008676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.009138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.012505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.013139 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.056818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b465e46d-575d-4bad-9e56-fa0dc6320d72 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.119526 Jan 24 16:55:27.062731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 436/858] 10.222.0.117 () {60 vars in 1347 bytes} [Mon Jan 24 16:55:26 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:27.182145 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:27.182662 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:27.191846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.192307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.193124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.193569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.228143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:55:27.346168 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-47402427-c5a1-4757-bb4c-e3edaacfa835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 204 len: 0 microversion: 2.20 time: 0.168364 Jan 24 16:55:27.347033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 437/859] 10.222.0.117 () {60 vars in 1284 bytes} [Mon Jan 24 16:55:27 2022] DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:55:27.356176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:27.357165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:27.371885 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.372812 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.373689 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:27.375469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:27.510636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:27.534407 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c14d477e-6dfb-44a2-bf03-6c30591772ba tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.542059 Jan 24 16:55:27.535588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 423/860] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:26 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:55:27.575768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:27.586315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:27.588218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:27.589728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-54e6c1a7-3416-48bc-8037-f770f11861aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.237996 Jan 24 16:55:27.590888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 438/861] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:27 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:28.556567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:28.558170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:28.567700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:28.568702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:28.570438 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:28.571132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:28.625845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:28.632974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:28.662384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:28.663467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:28.664477 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:28.665062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:28.882144 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:28.895262 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f55fcee7-31fe-467b-89db-6e33c4dec011 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.345757 Jan 24 16:55:28.896417 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 424/862] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:28 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:29.010246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:29.019771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:29.022030 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:29.023529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cecdc695-dba4-4f1f-9cc2-b020cb9e641d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 0.417570 Jan 24 16:55:29.025746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 439/863] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:28 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:29.912422 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:29.913029 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:29.931435 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:29.931882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:29.932676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:29.933114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:30.047954 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:30.048603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:30.063289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:30.066713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:30.074586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:30.075467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:30.486472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:30.497078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0becd75c-03e3-41d7-ad04-88585cce6495 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1759 microversion: 2.1 time: 0.587845 Jan 24 16:55:30.508066 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 425/864] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:29 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1759 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:31.501508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:31.518551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:31.519175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:31.519426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:31.520870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:31.522083 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-92106c61-4ce3-4a65-9de3-b61539f19fe8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1726 microversion: 2.20 time: 1.481981 Jan 24 16:55:31.522642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 440/865] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:30 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1726 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:31.533130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:31.533130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:31.533130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:31.533130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:31.808097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:31.818341 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bf94ff7e-15ee-4720-ac8e-cb103087ee20 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1762 microversion: 2.1 time: 0.304196 Jan 24 16:55:31.822065 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 426/866] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:31 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1762 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:55:32.234921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-aeccb8c6-38bd-4fb9-ac75-2e6ded94cafd req-c1473958-fc44-4b78-a155-7fbb5dc207d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb3e6d05-f352-44f0-88b9-77cf52d979a3", "name": "network-vif-deleted", "tag": "5af20f1e-1824-4d8f-ba09-7c0973152051"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:32.237273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:55:32.237273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:55:32.261672 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-aeccb8c6-38bd-4fb9-ac75-2e6ded94cafd req-c1473958-fc44-4b78-a155-7fbb5dc207d8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:32.269447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-aeccb8c6-38bd-4fb9-ac75-2e6ded94cafd req-c1473958-fc44-4b78-a155-7fbb5dc207d8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:32.318289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-aeccb8c6-38bd-4fb9-ac75-2e6ded94cafd req-c1473958-fc44-4b78-a155-7fbb5dc207d8 service nova] Creating event network-vif-deleted:5af20f1e-1824-4d8f-ba09-7c0973152051 for instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 on hv-cinder-82611 Jan 24 16:55:32.332784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-aeccb8c6-38bd-4fb9-ac75-2e6ded94cafd req-c1473958-fc44-4b78-a155-7fbb5dc207d8 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102784 Jan 24 16:55:32.337785 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 441/867] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:55:32.542817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:32.543450 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:32.569997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:32.571321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:32.572322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:32.572765 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:32.678443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:32.679239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:32.684021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lazy-loading 'fault' on Instance uuid fb3e6d05-f352-44f0-88b9-77cf52d979a3 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:55:32.837860 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:32.860226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:32.880873 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:32.882562 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cc006310-f315-446e-8c57-ba37cbfadda4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 200 len: 1374 microversion: 2.20 time: 0.344320 Jan 24 16:55:32.883768 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 427/868] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:32 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 1374 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:33.918355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:33.922234 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:33.969882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:33.985682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:33.989371 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:33.989843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:34.039633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. Jan 24 16:55:34.041078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:55:34.042370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e2d61fd7-98ad-4580-b572-e4989a6a29c7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 404 len: 111 microversion: 2.20 time: 0.145042 Jan 24 16:55:34.043789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 442/869] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:33 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:55:34.053056 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-26569ac7-538b-496e-a9b9-930701e1d5aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '.version_select at 0x7fba14d28160>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:34.108490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-26569ac7-538b-496e-a9b9-930701e1d5aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-623290570" status: 204 len: 0 microversion: 2.20 time: 0.059617 Jan 24 16:55:34.113138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 428/870] 10.222.0.117 () {60 vars in 1263 bytes} [Mon Jan 24 16:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-623290570 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:55:36.687547 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: .version_select at 0x7fba14ddf820>, body: {"keypair": {"name": "tempest-keypair-467692217"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:36.721919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:36.738808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:37.578311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:37.599426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:37.645890 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d6dd51b9-309d-41ef-b472-a818b7ffbf50 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.962943 Jan 24 16:55:37.657780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 443/871] 10.222.0.117 () {62 vars in 1203 bytes} [Mon Jan 24 16:55:36 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 965 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:55:38.338250 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Action: 'create', calling method: .version_select at 0x7fba14d47af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-665389750"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:38.360013 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:38.372534 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for user ef20979970584d92b04462166e7059b6 and project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:38.837027 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:38.841961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for user ef20979970584d92b04462166e7059b6 and project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'key_pairs'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:38.862255 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f41f2ea0-1707-4838-8db6-68c0823655ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.860277 Jan 24 16:55:38.863407 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 429/872] 10.222.0.117 () {60 vars in 1162 bytes} [Mon Jan 24 16:55:37 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:55:39.046410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Action: 'create', calling method: .version_select at 0x7fba14f871f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1092702864"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:39.079963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for project 7a337369b3dc467394f2629fb2f8487c. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:39.089483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for user 40a416737b484014bb7cf011bab63b63 and project 7a337369b3dc467394f2629fb2f8487c. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:40.236186 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for project 7a337369b3dc467394f2629fb2f8487c. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:40.241160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for user 40a416737b484014bb7cf011bab63b63 and project 7a337369b3dc467394f2629fb2f8487c. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:40.257172 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d6334e43-144c-4192-b1ed-26b67844807f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.449868 Jan 24 16:55:40.258053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 444/873] 10.222.0.117 () {60 vars in 1162 bytes} [Mon Jan 24 16:55:38 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:55:41.009783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-990954671", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a9684751-c334-42d8-84b0-fcdb27d5b403"}], "security_groups": [{"name": "tempest-securitygroup--1368252142"}], "key_name": "tempest-keypair-467692217", "user_data": "}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:41.228187 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] validate_networks() for [('a9684751-c334-42d8-84b0-fcdb27d5b403', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:55:42.251393 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:55:42.251935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:55:42.252316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:55:42.252802 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:55:42.253317 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:55:42.266970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:42.267505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:42.268446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:42.268961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:42.289876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for project 5ca1c94bee974fb986196c0be4064812. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:42.295905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Getting quotas for user 50e012c5fcde4462984a57878629fd6f and project 5ca1c94bee974fb986196c0be4064812. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:42.309332 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:55:42.312621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:55:42.398906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-96c1077c-6783-4a4b-a862-9257e8934c34 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.399200 Jan 24 16:55:42.405774 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 430/874] 10.222.0.117 () {62 vars in 1192 bytes} [Mon Jan 24 16:55:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jan 24 16:55:42.418627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:42.419294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:42.574539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:42.583621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:42.585555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:42.587013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-47ceaeb4-2446-4926-a45a-6ae8e973dbe5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1284 microversion: 2.20 time: 0.180078 Jan 24 16:55:42.598336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 445/875] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:42 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:43.610648 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:43.611242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:43.622570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:43.623082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:43.623874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:43.624780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:43.720943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:43.739756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:43.745085 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:43.747515 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a4c4e381-ba91-490e-99ca-f7ca4910475d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1288 microversion: 2.20 time: 0.142353 Jan 24 16:55:43.762801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 431/876] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:43 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:44.772682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:44.773342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:44.780529 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:44.780991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:44.781797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:44.782318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:44.856920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:44.867072 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:44.868611 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:44.869717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9e2a7d52-6137-4c91-8416-ad130c432917 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1342 microversion: 2.20 time: 0.100894 Jan 24 16:55:44.870279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 446/877] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:44 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:45.863781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1751432109", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:45.891596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:45.895029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:45.902418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:45.902909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:45.919562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:45.920297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:46.277616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:46.292173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:46.306884 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:46.308327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ba2021ae-3a23-4eab-a81f-9d2607a7dc4c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.424179 Jan 24 16:55:46.309137 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 447/878] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:45 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:46.677450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-b8ac4342-796c-49f6-8e7b-d84328a50124 req-260d23fb-3aa2-4e9f-8683-b7b212430fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:55:46.679448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:55:46.679448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:55:46.692062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-b8ac4342-796c-49f6-8e7b-d84328a50124 req-260d23fb-3aa2-4e9f-8683-b7b212430fe4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:46.692515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-b8ac4342-796c-49f6-8e7b-d84328a50124 req-260d23fb-3aa2-4e9f-8683-b7b212430fe4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:46.709661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-b8ac4342-796c-49f6-8e7b-d84328a50124 req-260d23fb-3aa2-4e9f-8683-b7b212430fe4 service nova] Creating event network-changed:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:55:46.715497 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-b8ac4342-796c-49f6-8e7b-d84328a50124 req-260d23fb-3aa2-4e9f-8683-b7b212430fe4 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263218 Jan 24 16:55:46.717184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 448/879] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:55:47.329648 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:47.330846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:47.344194 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:47.346173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:47.347409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:47.347870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:47.551437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:47.560413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:47.562446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:47.563872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2b4b7947-d7bc-46ce-a40d-07402cec6413 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.241558 Jan 24 16:55:47.570996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 449/880] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:47 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:48.582014 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:48.582677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:48.589073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:48.589528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:48.590358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:48.590832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:48.719580 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:48.727437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:48.728937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:48.730039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f1eddd11-b611-4755-9a0d-566f218b8b95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.152103 Jan 24 16:55:48.730596 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 450/881] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:48 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:49.750239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:49.751082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:49.757854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:49.758308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:49.759146 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:49.759624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:49.891451 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:49.900568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:49.902074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:49.903493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a411aca3-65cf-4598-bd7b-59384522671a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.157808 Jan 24 16:55:49.903840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 451/882] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:49 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:50.921373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:50.922207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:50.928758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:50.929209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:50.930006 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:50.930444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:51.068030 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:51.076685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:51.078376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:51.079534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4bec20d0-2ae8-4107-858c-d5ed7abf9543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.162471 Jan 24 16:55:51.080095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 452/883] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:50 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:52.098325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:52.098979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:52.107935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:52.108395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:52.109854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:52.110298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:52.246422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:52.254005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:52.255519 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:52.256607 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-43f2aa34-feb9-4f83-8fcc-7b763816bb4a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.163050 Jan 24 16:55:52.257155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 453/884] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:52 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:53.275779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:53.276417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:53.283460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:53.283912 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:53.284695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:53.285138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:53.424422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:53.432508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:53.434007 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:53.435129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-99d94cc0-dcc0-40db-b8fc-180d49b2f0c6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.163397 Jan 24 16:55:53.435716 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 454/885] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:53 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:54.452957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:54.453665 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:54.461179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:54.461629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:54.462459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:54.462940 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:54.596369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:54.604807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:54.606310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:54.607451 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5da42a68-6cf1-4a8e-888e-dacbc81bcd3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.158248 Jan 24 16:55:54.608017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 455/886] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:54 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:55.625248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:55.626495 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:55.633162 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:55.633621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:55.634422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:55.634905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:55.773202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:55.781824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:55.783356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:55.784461 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f9c54d2a-4832-4c4c-bc26-3fbe3489008f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.162957 Jan 24 16:55:55.785024 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 456/887] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:55 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:56.803725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:56.804358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:56.810437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:56.810914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:56.811685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:56.812216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:56.949183 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:56.957422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:56.959032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:56.960131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c26c223-d56a-4a2c-89bc-67b7808f2481 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.161108 Jan 24 16:55:56.960687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 457/888] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:56 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:57.979179 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:57.979821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:57.985952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:57.986400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:57.987932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:57.988367 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:58.129482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:58.137314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:58.138896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:58.139994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9eb847b3-0e85-416b-92af-5557c0ed228d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.164645 Jan 24 16:55:58.140546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 458/889] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:57 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:55:58.912468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] validate_networks() for None {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:55:59.158844 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:59.159458 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:59.166339 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:59.166804 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:59.167610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:59.168098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:59.194263 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:55:59.194687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:55:59.195195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:55:59.195609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:55:59.196024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:55:59.204902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:59.206051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:59.207050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:55:59.207493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:55:59.224865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Getting quotas for project 91c6a4a7b6294557aa79bfcd9fae3cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:55:59.228865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Getting quotas for user 948d485ebe0946079cf64cdac3312126 and project 91c6a4a7b6294557aa79bfcd9fae3cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:55:59.239682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:55:59.241848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:55:59.288097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-20c800d6-6238-4aa9-aff8-6b1faa0979e3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 13.430321 Jan 24 16:55:59.293525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 432/890] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:55:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 13432 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:55:59.305300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7138d98f-6ccd-4aac-9212-6c144a0f68f7 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:55:59.306370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7138d98f-6ccd-4aac-9212-6c144a0f68f7 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:55:59.310445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:59.319490 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:59.320979 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:59.322673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b5174a0e-592f-4a97-8f1e-77eabeb09612 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.167077 Jan 24 16:55:59.346356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 459/891] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:55:59 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:55:59.367259 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-7138d98f-6ccd-4aac-9212-6c144a0f68f7 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:55:59.374453 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7138d98f-6ccd-4aac-9212-6c144a0f68f7 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1219 microversion: 2.1 time: 0.074033 Jan 24 16:55:59.375035 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 433/892] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:55:59 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:00.343591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:00.344604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:00.351890 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:00.352355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:00.353142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:00.354363 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:00.392467 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:00.394216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:00.404610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:00.405080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:00.405939 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:00.406386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:00.507829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:00.515780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-606a7949-0c4d-4f55-b2f6-1522ac324191 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1279 microversion: 2.1 time: 0.127569 Jan 24 16:56:00.516351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 434/893] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:00 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:00.777036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:00.785337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:00.786885 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:00.788006 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d2cf6104-1db3-469e-a1bb-b65342f2f485 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.449857 Jan 24 16:56:00.788577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 460/894] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:00 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:56:01.543733 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:01.544586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:01.555334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:01.555923 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:01.556804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:01.557325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:01.699955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:01.708794 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-59acfaac-6c15-4cad-8be9-ab7208b08ff9 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.179095 Jan 24 16:56:01.713437 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 435/895] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:01 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:01.806170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:01.807522 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:01.817881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:01.818589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:01.819656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:01.820317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:02.039867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:02.054304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:02.056102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:02.057203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0552b2f8-a1ba-4fe9-8f57-007e2a52b54a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.255074 Jan 24 16:56:02.057757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 461/896] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:01 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:02.119327 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-7ef698a6-5b78-410a-940c-4f7817e119e2 req-145f08b9-7942-4841-988f-c1a32562da50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4d8f88b-800f-48b1-bed0-1784a3439466", "tag": "1bbc481f-ccef-44c9-9d06-c65006484edd"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:02.120921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:02.120921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:02.133946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-7ef698a6-5b78-410a-940c-4f7817e119e2 req-145f08b9-7942-4841-988f-c1a32562da50 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:02.134481 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-7ef698a6-5b78-410a-940c-4f7817e119e2 req-145f08b9-7942-4841-988f-c1a32562da50 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:02.153105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-7ef698a6-5b78-410a-940c-4f7817e119e2 req-145f08b9-7942-4841-988f-c1a32562da50 service nova] Creating event network-changed:1bbc481f-ccef-44c9-9d06-c65006484edd for instance e4d8f88b-800f-48b1-bed0-1784a3439466 on hv-cinder-82611 Jan 24 16:56:02.160968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-7ef698a6-5b78-410a-940c-4f7817e119e2 req-145f08b9-7942-4841-988f-c1a32562da50 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045143 Jan 24 16:56:02.162022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 436/897] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:02.725922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:02.726541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:02.732308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:02.732754 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:02.733535 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:02.733969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:02.956775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:02.964207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ce79ee82-eb5d-44d9-a14b-ba4ea663b7c1 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.241956 Jan 24 16:56:02.964962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 462/898] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:02 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:03.077964 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:03.079323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:03.088222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:03.088666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:03.089449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:03.089877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:03.228544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:03.236474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:03.238452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:03.239582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9c93312c-2cf4-4722-8fc7-9992d85b6b71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.167088 Jan 24 16:56:03.240166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 437/899] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:03 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:03.800776 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-ebd71378-0b30-427e-92a1-aa7f578a7d6d req-649e23b4-878d-466a-af16-bea4cf0d149c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:03.802559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:03.802559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:03.809505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-ebd71378-0b30-427e-92a1-aa7f578a7d6d req-649e23b4-878d-466a-af16-bea4cf0d149c service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:03.809956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-ebd71378-0b30-427e-92a1-aa7f578a7d6d req-649e23b4-878d-466a-af16-bea4cf0d149c service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:03.822285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-ebd71378-0b30-427e-92a1-aa7f578a7d6d req-649e23b4-878d-466a-af16-bea4cf0d149c service nova] Creating event network-vif-plugged:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:56:03.827322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-ebd71378-0b30-427e-92a1-aa7f578a7d6d req-649e23b4-878d-466a-af16-bea4cf0d149c service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085695 Jan 24 16:56:03.827914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 463/900] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:03.981286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:03.981898 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:03.988843 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:03.989503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:03.990291 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:03.990728 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:04.122143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:04.130234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4df4b35c-b020-4286-acf5-730b9dff4012 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.152668 Jan 24 16:56:04.130821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 438/901] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:03 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:04.258180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:04.258930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:04.265037 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:04.265490 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:04.266273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:04.266721 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:04.396511 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:04.404185 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:04.405692 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:04.406828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a9815ce1-2d46-4109-9ee8-3c98a45be63a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.153211 Jan 24 16:56:04.407395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 464/902] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:04 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:05.147121 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:05.147729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:05.153793 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:05.154432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:05.155237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:05.155664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:05.282471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:05.289613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f2c98f71-e847-4c7f-8684-250f31bd5da6 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.147258 Jan 24 16:56:05.290173 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 439/903] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:05 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:05.427372 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:05.427893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:05.435002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:05.435453 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:05.436247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:05.436686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:05.573549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:05.581682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:05.583830 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:05.585642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f1064ba1-2829-4d03-87e7-cc947e4b38ae tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1410 microversion: 2.20 time: 0.163860 Jan 24 16:56:05.586391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 465/904] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:05 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:06.305869 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:06.306455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:06.312687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.313135 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.313941 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.315252 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.441505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:06.448655 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-08669834-b64b-485f-aa3f-ee64da7801ab tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.146702 Jan 24 16:56:06.449226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 440/905] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:06 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:06.604721 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:06.605359 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:06.612807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.613267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.614055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.614492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.749005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:06.757330 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:06.758920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:06.760073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-79eaf15d-9f23-4d8f-9706-92f0d3933470 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1601 microversion: 2.20 time: 0.159118 Jan 24 16:56:06.760645 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 466/906] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:06 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:06.777599 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:06.777996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-538471401", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-665389750", "security_groups": [{"name": "tempest-secgroup-smoke-1211813030"}], "networks": [{"uuid": "47466270-541d-4039-a73f-7e91d25c0bd6"}], "block_device_mapping_v2": [{"uuid": "1e806e7b-4774-4178-a01e-d53e12e675fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:06.778124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:06.783969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.784411 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.785184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:06.785614 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:06.866734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3bb7e285-860e-4b3d-bb78-025d42c218db tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092596 Jan 24 16:56:06.867355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 467/907] 10.222.0.117 () {60 vars in 1320 bytes} [Mon Jan 24 16:56:06 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:56:06.884781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] validate_networks() for [('47466270-541d-4039-a73f-7e91d25c0bd6', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:56:07.263111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:56:07.263563 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:56:07.264022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:56:07.264434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:56:07.264851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:56:07.274143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:07.274598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:07.275457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:07.275896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:07.294078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:56:07.298160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Getting quotas for user ef20979970584d92b04462166e7059b6 and project 511e72017a4b4da7a0748dae5a59e0ac. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:56:07.353070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:56:07.355211 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e806e7b-4774-4178-a01e-d53e12e675fd',volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:56:07.465947 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:07.466627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:07.476644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:07.477803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:07.479091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:07.479753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:07.484717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-39b42b91-f133-4b2c-b50d-711e255bc5c6 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.710576 Jan 24 16:56:07.485681 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 441/908] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:56:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:56:07.497431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-070c631c-b176-4b34-a1e4-cfa2c68fb9dd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:07.498517 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-070c631c-b176-4b34-a1e4-cfa2c68fb9dd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:07.576780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-070c631c-b176-4b34-a1e4-cfa2c68fb9dd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:07.584373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-070c631c-b176-4b34-a1e4-cfa2c68fb9dd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1090 microversion: 2.1 time: 0.090956 Jan 24 16:56:07.585061 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 442/909] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:07 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1090 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:07.796845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-a097b157-56bf-4ea6-bddb-f4a195c6ebaf req-4a9fcbd6-2cc5-4b33-b544-6587cb48a808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d8f88b-800f-48b1-bed0-1784a3439466", "name": "network-vif-plugged", "status": "completed", "tag": "1bbc481f-ccef-44c9-9d06-c65006484edd"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:07.798780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:07.798780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:07.819697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a097b157-56bf-4ea6-bddb-f4a195c6ebaf req-4a9fcbd6-2cc5-4b33-b544-6587cb48a808 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:07.819978 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-a097b157-56bf-4ea6-bddb-f4a195c6ebaf req-4a9fcbd6-2cc5-4b33-b544-6587cb48a808 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:07.826094 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:07.840313 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f59a94d2-e1f7-443f-ab3e-c5fb2d9e7cd0 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.378594 Jan 24 16:56:07.841303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 468/910] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:07 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:07.859008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-a097b157-56bf-4ea6-bddb-f4a195c6ebaf req-4a9fcbd6-2cc5-4b33-b544-6587cb48a808 service nova] Creating event network-vif-plugged:1bbc481f-ccef-44c9-9d06-c65006484edd for instance e4d8f88b-800f-48b1-bed0-1784a3439466 on hv-cinder-82611 Jan 24 16:56:07.859008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-a097b157-56bf-4ea6-bddb-f4a195c6ebaf req-4a9fcbd6-2cc5-4b33-b544-6587cb48a808 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063446 Jan 24 16:56:07.859008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 443/911] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:07.985094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1084358410", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1092702864", "security_groups": [{"name": "tempest-secgroup-smoke-245594148"}], "block_device_mapping_v2": [{"uuid": "2574e922-4813-4838-9240-99c9966aa4b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65b89cb5-235f-4d33-82a0-9e74a9bccb1e"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:08.122973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] validate_networks() for [('65b89cb5-235f-4d33-82a0-9e74a9bccb1e', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:56:08.345513 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:08.346505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:08.353041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.353501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.354310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.354735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.548215 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-805a0e70-5c47-46c3-86f5-a6d42d7c67ec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.206404 Jan 24 16:56:08.553049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 469/912] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:08 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:08.556008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-51512746-4231-4d3b-8f23-f649d1c202f7 req-4c26edef-b837-480d-a831-0392f3af1d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:08.557501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:08.557501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:08.567013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-51512746-4231-4d3b-8f23-f649d1c202f7 req-4c26edef-b837-480d-a831-0392f3af1d6b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.567464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-51512746-4231-4d3b-8f23-f649d1c202f7 req-4c26edef-b837-480d-a831-0392f3af1d6b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.581974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-51512746-4231-4d3b-8f23-f649d1c202f7 req-4c26edef-b837-480d-a831-0392f3af1d6b service nova] Creating event network-changed:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:56:08.587232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-51512746-4231-4d3b-8f23-f649d1c202f7 req-4c26edef-b837-480d-a831-0392f3af1d6b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035371 Jan 24 16:56:08.588088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 470/913] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:08.601353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:08.602358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:08.610571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.612464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.613324 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.613768 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.690008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:08.698887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d1d71cba-4d2b-47c9-8526-da237cee268d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1188 microversion: 2.1 time: 0.101792 Jan 24 16:56:08.699467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 471/914] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:08 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:08.726928 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:56:08.727455 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:56:08.728011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:56:08.728491 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:56:08.728963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:56:08.739167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.739689 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.740569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.741088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.757850 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:56:08.762202 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for user 40a416737b484014bb7cf011bab63b63 and project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:56:08.821524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:56:08.823770 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2574e922-4813-4838-9240-99c9966aa4b5',volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:56:08.857113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:08.857894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:08.864388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.865158 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.866053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:08.866549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:08.987574 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d7117a45-5617-412e-a327-c72d15221b40 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.006292 Jan 24 16:56:08.988187 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 444/915] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:56:07 2022] POST /compute/v2.1/servers => generated 407 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:56:08.998739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2d224076-8094-4e92-bf81-c1f005ff35d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:08.999415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2d224076-8094-4e92-bf81-c1f005ff35d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:09.199423 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:09.205774 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2d224076-8094-4e92-bf81-c1f005ff35d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:09.227030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2d224076-8094-4e92-bf81-c1f005ff35d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1098 microversion: 2.1 time: 0.232046 Jan 24 16:56:09.239593 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3850881-6721-4db6-8ada-2a09d757937d tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1319 microversion: 2.1 time: 0.373977 Jan 24 16:56:09.239593 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 472/916] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:08 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:09.241130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 445/917] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:08 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1098 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:09.562736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:09.563800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:09.581921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:09.583773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:09.584832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:09.585453 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:09.690207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c8c5c65d-3318-4378-9085-7df20f31555f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.130810 Jan 24 16:56:09.693901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 473/918] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:09 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:09.720320 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:09.721300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:09.735842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:09.737799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:09.741603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:09.743705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:09.857288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:09.871613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-489590bf-b6e4-4072-93d3-d67c96391c35 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1206 microversion: 2.1 time: 0.157752 Jan 24 16:56:09.886238 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 446/919] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:09 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1206 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:10.249216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:10.249654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:10.250549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.255070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.260823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.261286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.262097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.262538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.266839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.267267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.268042 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.268459 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.337746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:10.347084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ae5402d1-b512-4fb8-897e-2b56e8a3446a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1196 microversion: 2.1 time: 0.101152 Jan 24 16:56:10.347892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 474/920] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:10 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1196 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:10.560973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:10.569200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-966916c7-5c45-426c-b585-909e11f6f5a3 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1469 microversion: 2.1 time: 0.323603 Jan 24 16:56:10.569790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 447/921] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:10 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1469 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:10.610347 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:10.613204 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.620258 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.620715 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.621678 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.622280 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.652703 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:56:10.702277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:10.703613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.710672 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.711482 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.712546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.713504 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.749364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b13589a4-7c22-4d6e-94de-9f94926e1a9a tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "DELETE /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 204 len: 0 microversion: 2.1 time: 0.144075 Jan 24 16:56:10.750134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 475/922] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:56:10 2022] DELETE /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:56:10.761472 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:10.763650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.770076 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.770910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.771705 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.772139 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.818610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0cca779c-6ec0-4d72-941e-7eb46fab5ef8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.120864 Jan 24 16:56:10.819376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 448/923] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:10 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:10.892105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:10.893742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:10.900616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.902502 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.903600 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:10.904249 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:10.979669 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:10.987771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9afe8572-d2d5-4eaa-bab3-67976c305057 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1475 microversion: 2.1 time: 0.232241 Jan 24 16:56:10.988352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 476/924] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:10 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:11.230692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:11.249728 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d93fc740-8a8e-456e-8140-a48e607ec8b3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.362081 Jan 24 16:56:11.266099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 449/925] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:10 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:11.313056 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-faba3f59-b4f7-4ad4-8c79-8fca833a7a64 req-c0ee0e7d-7cd6-4cad-b0eb-b4bebd872c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:11.315887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:11.315887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:11.327724 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-faba3f59-b4f7-4ad4-8c79-8fca833a7a64 req-c0ee0e7d-7cd6-4cad-b0eb-b4bebd872c41 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:11.328539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-faba3f59-b4f7-4ad4-8c79-8fca833a7a64 req-c0ee0e7d-7cd6-4cad-b0eb-b4bebd872c41 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:11.347686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-faba3f59-b4f7-4ad4-8c79-8fca833a7a64 req-c0ee0e7d-7cd6-4cad-b0eb-b4bebd872c41 service nova] Creating event network-changed:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 16:56:11.355274 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-faba3f59-b4f7-4ad4-8c79-8fca833a7a64 req-c0ee0e7d-7cd6-4cad-b0eb-b4bebd872c41 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140506 Jan 24 16:56:11.356408 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 477/926] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:11.366220 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:11.367008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:11.373470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:11.373925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:11.374809 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:11.375315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:11.590730 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:11.599614 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bd7d8c18-3a72-46d4-8dd9-07e88f9834e4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.238703 Jan 24 16:56:11.600233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 450/927] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:11 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:11.832561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:11.833798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:11.857041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:11.857919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:11.863656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:11.864385 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:11.953987 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7e29c997-3394-4b40-b069-a518c05cf944 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.127191 Jan 24 16:56:11.956221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 478/928] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:11 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:12.006337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:12.007613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:12.018800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.020324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.021212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.021708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.075952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-f3effe45-f258-48bb-beee-ed6394c6f421 req-34f73165-0a47-48f9-91d9-006bae288ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921adf61-2d82-49af-8dd2-dd2fbbd585b4", "tag": "41d7d71d-3e7f-44e5-9394-f4d62e1f557f"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:12.078045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:12.078045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:12.087696 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-f3effe45-f258-48bb-beee-ed6394c6f421 req-34f73165-0a47-48f9-91d9-006bae288ce6 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.088541 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-f3effe45-f258-48bb-beee-ed6394c6f421 req-34f73165-0a47-48f9-91d9-006bae288ce6 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.102170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-f3effe45-f258-48bb-beee-ed6394c6f421 req-34f73165-0a47-48f9-91d9-006bae288ce6 service nova] Creating event network-changed:41d7d71d-3e7f-44e5-9394-f4d62e1f557f for instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 on hv-cinder-82611 Jan 24 16:56:12.107919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-f3effe45-f258-48bb-beee-ed6394c6f421 req-34f73165-0a47-48f9-91d9-006bae288ce6 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035873 Jan 24 16:56:12.108779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 479/929] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:12.254205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:12.263323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-63e1cabb-4dc9-4528-8113-47c30d490e65 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1475 microversion: 2.1 time: 0.261815 Jan 24 16:56:12.275584 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:12.276395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:12.276830 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 451/930] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:12 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1475 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:12.286724 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.287630 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.288668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.289327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.616098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:12.616700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:12.622635 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.623108 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.623882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.624318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.709890 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:12.718620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5eebf223-6d03-47f1-87e9-219ff8dd3fe0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.447819 Jan 24 16:56:12.719224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 480/931] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:12 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:12.847177 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:12.855364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0dec6406-9927-424b-8295-fed3c2b6c1fb tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.242850 Jan 24 16:56:12.856279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 452/932] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:12 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:12.965214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:12.966383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:12.973444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.974958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:12.975965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:12.976578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.055009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9aaea72a-0637-4ae8-9d0a-16d1ca2e8024 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.093023 Jan 24 16:56:13.055902 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 481/933] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:12 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:13.284377 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:13.286092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:13.293860 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.294630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.295587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.296300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.333218 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.333970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.334637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lazy-loading 'fault' on Instance uuid e4d8f88b-800f-48b1-bed0-1784a3439466 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:56:13.381973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '948d485ebe0946079cf64cdac3312126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91c6a4a7b6294557aa79bfcd9fae3cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:13.382194 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-164ceb3f-70df-4513-91af-be8fab457520 req-931462f4-3dca-4b55-82ca-75140c7a4c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4d8f88b-800f-48b1-bed0-1784a3439466", "name": "network-vif-deleted", "tag": "1bbc481f-ccef-44c9-9d06-c65006484edd"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:13.383893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:13.383893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:13.392819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a9a897ef-75b4-4f3c-b28f-b5925b641240 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 200 len: 1309 microversion: 2.1 time: 0.112171 Jan 24 16:56:13.393026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-164ceb3f-70df-4513-91af-be8fab457520 req-931462f4-3dca-4b55-82ca-75140c7a4c9b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.393555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-164ceb3f-70df-4513-91af-be8fab457520 req-931462f4-3dca-4b55-82ca-75140c7a4c9b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.394008 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 453/934] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:13 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:13.405577 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-164ceb3f-70df-4513-91af-be8fab457520 req-931462f4-3dca-4b55-82ca-75140c7a4c9b service nova] Creating event network-vif-deleted:1bbc481f-ccef-44c9-9d06-c65006484edd for instance e4d8f88b-800f-48b1-bed0-1784a3439466 on hv-cinder-82611 Jan 24 16:56:13.411499 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-164ceb3f-70df-4513-91af-be8fab457520 req-931462f4-3dca-4b55-82ca-75140c7a4c9b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033504 Jan 24 16:56:13.412096 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 482/935] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:13.738226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:13.739135 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:13.746501 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.746983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.747773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.748217 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.873637 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:13.874325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:13.881228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.881674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.882456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:13.882929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:13.883912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:13.891662 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ae7f3b4a-5fe9-48d5-a514-a8f091589ae8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.158476 Jan 24 16:56:13.892698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 454/936] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:13 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:14.014786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:14.022122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d34d30e2-2712-4b34-8a10-3fb7156d5f33 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.153005 Jan 24 16:56:14.022672 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 483/937] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:13 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:14.065383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:14.066369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:14.072284 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.072740 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:14.073527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.073984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:14.133505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0461e463-ea4e-4372-bee5-2a385be6eb31 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.071771 Jan 24 16:56:14.134122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 455/938] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:14 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:14.410931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:14.411463 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] [instance: e4d8f88b-800f-48b1-bed0-1784a3439466] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:14.417743 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.418190 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:14.418991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.419439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:14.432507 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] HTTP exception thrown: Instance e4d8f88b-800f-48b1-bed0-1784a3439466 could not be found. Jan 24 16:56:14.433081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] Returning 404 to user: Instance e4d8f88b-800f-48b1-bed0-1784a3439466 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:56:14.433883 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6aa48d68-3322-4773-b959-d8108bc8a824 tempest-VolumesNegativeTest-1684877513 tempest-VolumesNegativeTest-1684877513-project] 10.222.0.117 "GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466" status: 404 len: 111 microversion: 2.1 time: 0.027356 Jan 24 16:56:14.434394 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 484/939] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:14 2022] GET /compute/v2.1/servers/e4d8f88b-800f-48b1-bed0-1784a3439466 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:14.909628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:14.910447 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:14.917555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.918070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:14.918947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:14.919463 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:15.038551 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:15.039219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:15.046389 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:15.046889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:15.047702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:15.048230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:15.067154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:15.078987 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d63a280f-2887-4ca2-8c77-88ed78a0b5da tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.173360 Jan 24 16:56:15.080188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 456/940] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:14 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:15.144622 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:15.145757 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:15.151717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:15.152166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:15.152954 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:15.153393 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:15.211452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:15.219232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-faca090b-2edf-4b09-9c10-f54c7c04849f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.184341 Jan 24 16:56:15.221017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 485/941] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:15 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:15.221907 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1a048933-fe24-4b6d-a7a2-30b581943a4e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.081196 Jan 24 16:56:15.222631 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 457/942] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:15 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:16.096315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:16.096712 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:16.103484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.103960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.105074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.105589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.234745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:16.236603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:16.243286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.243751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.244551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.244991 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.249699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:16.259097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c46bb9c5-2530-4cc0-9bf9-7b42e19ea444 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.166919 Jan 24 16:56:16.259831 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 486/943] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:16 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:16.264654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:16.265524 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:16.271977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.277219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.277219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:16.277219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:16.310632 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-eb346adc-a183-4f89-a56b-41623340a142 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.081339 Jan 24 16:56:16.311331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 458/944] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:16 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:16.412187 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:16.419867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cb50b5f2-b094-4df6-9af0-bfc4cb2ce6a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.158894 Jan 24 16:56:16.420417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 487/945] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:16 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:17.277081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:17.277780 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:17.284994 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.285449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.286233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.286673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.321718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:17.322707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:17.329735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.330564 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.331353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.331795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.401320 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-702e32bd-0942-4486-b343-b4b057768af7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.083246 Jan 24 16:56:17.401977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 488/946] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:17 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:17.418499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:17.426713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-32e70f67-f1ec-44a1-92b3-a1eda3ddddcd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.153495 Jan 24 16:56:17.427317 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 459/947] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:17 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:17.437437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:17.438167 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:17.445679 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.446135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.446953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:17.447399 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:17.580785 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:17.587998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0bbd3747-415c-4c3e-bf87-8c8bccf4d34f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.154523 Jan 24 16:56:17.588553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 489/948] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:17 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:18.196535 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-541277728"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:18.197071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:18.203211 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.203654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.204984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.205366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.341282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.network.security_group_api [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Removing security group 8a75eec8-0dcc-4941-a2aa-bc424b0564f6 from port 7a1e30e0-8581-4715-9b37-9a84fccf7f10 Jan 24 16:56:18.412988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:18.414370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:18.421283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.421283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.422210 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.423082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.495439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6066737f-7daa-40f3-a650-b2192e11d053 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.086098 Jan 24 16:56:18.496608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 490/949] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:18 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:18.503748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:18.504653 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:18.513948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.514398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.516059 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.517065 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.668153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:18.680775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b751a65e-f086-4f8a-8474-349310bc98f2 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.182675 Jan 24 16:56:18.682135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 491/950] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:18 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:18.695039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:18.695736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:18.716230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f70b58e5-7b9d-4b67-9ee5-57229c86bbf4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action" status: 202 len: 0 microversion: 2.1 time: 0.523318 Jan 24 16:56:18.716992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.717454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.718231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 460/951] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:18 2022] POST /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:18.722822 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.723379 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.728821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-8bddf5e1-1502-4074-9434-2e1a3c452c4e req-18259bf7-5694-4d61-b46c-1235913cdaec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:18.731047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:18.731047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:18.750208 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8bddf5e1-1502-4074-9434-2e1a3c452c4e req-18259bf7-5694-4d61-b46c-1235913cdaec service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:18.751297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-8bddf5e1-1502-4074-9434-2e1a3c452c4e req-18259bf7-5694-4d61-b46c-1235913cdaec service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:18.788277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-8bddf5e1-1502-4074-9434-2e1a3c452c4e req-18259bf7-5694-4d61-b46c-1235913cdaec service nova] Creating event network-changed:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:56:18.794695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-8bddf5e1-1502-4074-9434-2e1a3c452c4e req-18259bf7-5694-4d61-b46c-1235913cdaec service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069806 Jan 24 16:56:18.796024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 461/952] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:18.974439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:18.982795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c59ab7cd-e6c7-425b-9c9d-88846f69b614 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.299223 Jan 24 16:56:18.985798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 492/953] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:18 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:19.507892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:19.509077 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:19.515719 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:19.516095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:19.517520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:19.517955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:19.577182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-447e38cc-5b58-4d03-9a92-e1c8c513c4b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 14 microversion: 2.20 time: 0.073135 Jan 24 16:56:19.579857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 462/954] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:19 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:19.699111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:19.700369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:19.706790 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:19.707355 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:19.708146 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:19.708589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:19.853730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:19.862262 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5d52ac03-13e7-486d-90b8-ffdf429ba402 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.166853 Jan 24 16:56:19.862959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 493/955] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:19 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:20.002949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:20.003806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:20.010804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.011863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.012876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.013496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.165183 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:20.165840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:20.173099 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.174197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.175403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.176304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.198826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:20.206345 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fe28a68d-082e-4468-8766-3ea22bd5e619 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.208387 Jan 24 16:56:20.207311 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 463/956] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:19 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:20.261917 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lazy-loading 'services' on Instance uuid 6586b895-689e-45ea-a639-70c04b5ddbc7 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:56:20.333071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7fc44149-6b69-4d66-926f-6bc74d10acf2 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments/bce33335-7884-448b-b6b4-3db806e6222b" status: 202 len: 0 microversion: 2.1 time: 0.176034 Jan 24 16:56:20.333729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 494/957] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:56:20 2022] DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments/bce33335-7884-448b-b6b4-3db806e6222b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:20.341666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:20.342641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:20.349988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.350258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.351070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.351496 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.383314 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-08e93536-820b-41d5-8d8d-3b8db6ab65e5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Jan 24 16:56:20.383924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 464/958] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:56:20 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:20.588218 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:20.589521 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:20.596783 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.597235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.598033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.598467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.670446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3235f06e-3ea3-426c-8456-fc2f7f165e1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 2071 microversion: 2.20 time: 0.086112 Jan 24 16:56:20.673868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 495/959] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:20 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 2071 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:20.821331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-37b4d360-a7e4-4b2a-94df-5b5ed20cad3d req-f6e39f99-e4ee-4d8a-8964-1317a7c8bd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:20.823012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:20.823012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:20.831358 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-37b4d360-a7e4-4b2a-94df-5b5ed20cad3d req-f6e39f99-e4ee-4d8a-8964-1317a7c8bd1f service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.831741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-37b4d360-a7e4-4b2a-94df-5b5ed20cad3d req-f6e39f99-e4ee-4d8a-8964-1317a7c8bd1f service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.842382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-37b4d360-a7e4-4b2a-94df-5b5ed20cad3d req-f6e39f99-e4ee-4d8a-8964-1317a7c8bd1f service nova] Creating event network-changed:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:56:20.848598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-37b4d360-a7e4-4b2a-94df-5b5ed20cad3d req-f6e39f99-e4ee-4d8a-8964-1317a7c8bd1f service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030933 Jan 24 16:56:20.849395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 465/960] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:20.879984 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:20.880684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:20.898235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.898695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:20.899528 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:20.899974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.178106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:21.186081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5fcbaf66-9b13-47ee-b2ca-1fd20d8508ad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.310675 Jan 24 16:56:21.188690 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 496/961] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:20 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:21.224935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:21.226321 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:21.232564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.233099 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.233971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.234484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.381596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:21.389772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5f9dcfbf-91d8-408e-89d9-4794db3a35c1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.170048 Jan 24 16:56:21.390356 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 466/962] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:21 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:21.397495 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:21.398643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:21.405053 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.405509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.406317 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.407384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.437306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ff47897f-ee81-44aa-ac4b-5c2acd4a46e4 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046033 Jan 24 16:56:21.437869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 497/963] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:56:21 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:21.448468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:21.449199 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:21.460405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.460853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.461671 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.462120 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.539247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] HTTP exception thrown: Instance 6586b895-689e-45ea-a639-70c04b5ddbc7 is not attached to volume bce33335-7884-448b-b6b4-3db806e6222b Jan 24 16:56:21.539917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Returning 404 to user: Instance 6586b895-689e-45ea-a639-70c04b5ddbc7 is not attached to volume bce33335-7884-448b-b6b4-3db806e6222b {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:56:21.540982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-46a44990-14a4-4026-aeab-d1b5e503e215 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments/bce33335-7884-448b-b6b4-3db806e6222b" status: 404 len: 154 microversion: 2.1 time: 0.096513 Jan 24 16:56:21.541628 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 467/964] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:56:21 2022] DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7/os-volume_attachments/bce33335-7884-448b-b6b4-3db806e6222b => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:21.681803 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:21.682790 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:21.690049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.690739 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.691644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:21.692088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:21.769950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b5ca0ea0-be2e-4855-8089-384892c00a5f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 12367 microversion: 2.20 time: 0.091579 Jan 24 16:56:21.770687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 498/965] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:21 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 12367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:22.204214 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:22.204828 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:22.210682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.211158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.211940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.212374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.339883 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:22.349017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0fa0a3b8-ad66-4f7c-9c6d-69776d803dad tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.148429 Jan 24 16:56:22.349676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 468/966] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:22 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:22.406412 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:22.407680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:22.414927 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.415484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.416277 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.416719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.513810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-ed7e9bb7-2158-45da-9a54-5834a71473dc req-bfacda1a-da4b-419d-a947-77befd7e1f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "name": "network-vif-plugged", "status": "completed", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:22.515665 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:22.515665 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:22.524054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ed7e9bb7-2158-45da-9a54-5834a71473dc req-bfacda1a-da4b-419d-a947-77befd7e1f44 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.524368 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ed7e9bb7-2158-45da-9a54-5834a71473dc req-bfacda1a-da4b-419d-a947-77befd7e1f44 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.539806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-ed7e9bb7-2158-45da-9a54-5834a71473dc req-bfacda1a-da4b-419d-a947-77befd7e1f44 service nova] Creating event network-vif-plugged:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 16:56:22.544850 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-ed7e9bb7-2158-45da-9a54-5834a71473dc req-bfacda1a-da4b-419d-a947-77befd7e1f44 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035238 Jan 24 16:56:22.545650 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 469/967] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:22.559456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:22.568654 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a8935a44-19c0-4fd1-94b0-74feebc66024 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.166268 Jan 24 16:56:22.569225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 499/968] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:22 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:22.678140 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:22.679089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:22.685454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.685912 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.686715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.687186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.713138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:56:22.781994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:22.783219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:22.790041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.790732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.791748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.792366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.810635 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-df4db8e7-9c4b-4ff5-90ca-8c11320c3075 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 204 len: 0 microversion: 2.1 time: 0.136803 Jan 24 16:56:22.817638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 470/969] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:56:22 2022] DELETE /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:56:22.828199 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:22.829654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:22.835875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.836329 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.837149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:22.837588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:22.870557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8cd61ecc-a1d4-47a9-a5af-2f623cfe164a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 18356 microversion: 2.20 time: 0.092174 Jan 24 16:56:22.874256 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 500/970] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:22 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 18356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:22.967428 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:22.975402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-41309fd0-7ff4-45ae-a919-fc89c5930c65 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1557 microversion: 2.1 time: 0.156533 Jan 24 16:56:22.975978 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 471/971] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:22 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:23.365758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:23.366465 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:23.373795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.374248 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.375181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.375766 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.513478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:23.521695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-485aeb20-4a38-46db-afc9-c414aac16a17 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1262 microversion: 2.1 time: 0.159975 Jan 24 16:56:23.522524 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 501/972] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:23 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:23.585684 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:23.586301 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:23.592899 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.593639 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.595726 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.596172 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.731315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:23.738862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-13ee8c9a-0cb1-4bff-bfef-2f349860763c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.156932 Jan 24 16:56:23.739438 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 472/973] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:23 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:23.882025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:23.883003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:23.889225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.889671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.890446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:23.890918 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:23.974044 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c6248ae0-4cce-4e87-93b6-0c74fa5cf9fa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 18915 microversion: 2.20 time: 0.095443 Jan 24 16:56:23.977690 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 502/974] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:23 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 18915 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:23.993425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:23.994166 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:24.000457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.001231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.002025 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.002466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.134022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:24.142033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-43fa131e-0db5-4388-985b-5aaab650ed63 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1557 microversion: 2.1 time: 0.153560 Jan 24 16:56:24.142703 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 473/975] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:23 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:24.538937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:24.539643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:24.546554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.547112 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.547977 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.548420 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.577544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-ea4aa7d8-496f-4053-bb80-8e4b2bd7a649 req-083775c6-da79-4387-951c-8da1e5d855cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921adf61-2d82-49af-8dd2-dd2fbbd585b4", "name": "network-vif-plugged", "status": "completed", "tag": "41d7d71d-3e7f-44e5-9394-f4d62e1f557f"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:24.580405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:24.580405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:24.587309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ea4aa7d8-496f-4053-bb80-8e4b2bd7a649 req-083775c6-da79-4387-951c-8da1e5d855cf service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.587867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ea4aa7d8-496f-4053-bb80-8e4b2bd7a649 req-083775c6-da79-4387-951c-8da1e5d855cf service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.600540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-ea4aa7d8-496f-4053-bb80-8e4b2bd7a649 req-083775c6-da79-4387-951c-8da1e5d855cf service nova] Creating event network-vif-plugged:41d7d71d-3e7f-44e5-9394-f4d62e1f557f for instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 on hv-cinder-82611 Jan 24 16:56:24.605315 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-ea4aa7d8-496f-4053-bb80-8e4b2bd7a649 req-083775c6-da79-4387-951c-8da1e5d855cf service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031280 Jan 24 16:56:24.606111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 474/976] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:24.684408 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:24.692413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-29a7793d-1ce0-4360-aa9d-88d1a67657fd tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1445 microversion: 2.1 time: 0.157572 Jan 24 16:56:24.692976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 503/977] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:24 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:24.709790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:24.710489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:24.716575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.717024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.717795 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.718230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.756554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:24.757290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:24.765334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.766540 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.768221 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.768685 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.949616 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:24.958681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-07ca9484-278d-45aa-965a-7b45043efa9c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.205807 Jan 24 16:56:24.959297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 504/978] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:24 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:24.985780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:24.986809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:24.992651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.993104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:24.993916 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:24.994353 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.015272 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:25.023039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e2f01756-53ae-4c73-8f2d-29f578eb74ef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1445 microversion: 2.1 time: 0.317240 Jan 24 16:56:25.023609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 475/979] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:24 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1445 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:25.158741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:25.159374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:25.165351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.165797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.166675 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.167148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.279464 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3d2ce48d-ce54-43f6-adeb-e49f74164835 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 21445 microversion: 2.20 time: 0.297598 Jan 24 16:56:25.280593 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 505/980] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:24 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 21445 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:25.353536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:25.362083 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3def0621-79e4-4592-9cc9-88cf56880e67 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1557 microversion: 2.1 time: 0.206948 Jan 24 16:56:25.363033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 476/981] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:25 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1557 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:25.452810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:25.454829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:25.462016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.462637 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.463634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.464237 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.496650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7a6f9571-bee8-45d1-a94d-0a0076bba107 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047827 Jan 24 16:56:25.502361 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 506/982] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:56:25 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:25.555237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:25.555945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:25.561876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.562432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.563773 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.564461 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.589981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:56:25.679410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fd130d68-802e-4070-a239-50bbfc79a359 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 204 len: 0 microversion: 2.1 time: 0.127235 Jan 24 16:56:25.680654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 477/983] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:56:25 2022] DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:56:25.689272 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:25.689893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:25.700069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.701160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.704298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.704951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.792310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-5516fcce-4820-423e-a5a5-59540ab6514e req-de3e1a03-c013-4599-8c08-cebf1228a674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6586b895-689e-45ea-a639-70c04b5ddbc7", "name": "network-vif-deleted", "tag": "7a1e30e0-8581-4715-9b37-9a84fccf7f10"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:25.794634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:25.794634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:25.806131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5516fcce-4820-423e-a5a5-59540ab6514e req-de3e1a03-c013-4599-8c08-cebf1228a674 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.807106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-5516fcce-4820-423e-a5a5-59540ab6514e req-de3e1a03-c013-4599-8c08-cebf1228a674 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.832052 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-5516fcce-4820-423e-a5a5-59540ab6514e req-de3e1a03-c013-4599-8c08-cebf1228a674 service nova] Creating event network-vif-deleted:7a1e30e0-8581-4715-9b37-9a84fccf7f10 for instance 6586b895-689e-45ea-a639-70c04b5ddbc7 on hv-cinder-82611 Jan 24 16:56:25.837637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-5516fcce-4820-423e-a5a5-59540ab6514e req-de3e1a03-c013-4599-8c08-cebf1228a674 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051826 Jan 24 16:56:25.839020 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 478/984] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:25.896150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:25.904805 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-aba1bd3e-2cc3-4afe-8e19-af608635ad6e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1679 microversion: 2.1 time: 0.219735 Jan 24 16:56:25.905385 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 507/985] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:25 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:25.975953 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:25.976673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:25.982713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.983200 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:25.983983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:25.984478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.291723 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:26.292625 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:26.300418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.301140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.302143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.302578 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.308128 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:26.316873 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6a42b9a4-32bf-4d37-b789-ec72afa45f4b tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1269 microversion: 2.1 time: 0.345005 Jan 24 16:56:26.317763 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 479/986] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:25 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1269 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:26.379277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:26.380082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:26.386352 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.386847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.387649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.388088 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.394668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b05e3565-f468-471c-8750-92a810edfaec tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 22894 microversion: 2.20 time: 0.106514 Jan 24 16:56:26.395391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 508/987] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:26 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 22894 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:26.424839 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.425302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.426020 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lazy-loading 'fault' on Instance uuid 6586b895-689e-45ea-a639-70c04b5ddbc7 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:56:26.603944 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07e0cd23d0c4f2ab7aba38a564dc693', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60ca23ca0784aef8638d92cfdca914f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:26.610973 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-32875f27-06f0-49d4-af1d-63fffe0b0dab tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 200 len: 1352 microversion: 2.1 time: 0.235808 Jan 24 16:56:26.611546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 480/988] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:26 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 1352 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:26.924323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:26.925920 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:26.932891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.933348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:26.939919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:26.940380 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.075088 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:27.083422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b5683877-c34d-49ba-98b6-9c37a396cdb5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1679 microversion: 2.1 time: 0.164072 Jan 24 16:56:27.083991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 509/989] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:26 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:27.333560 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:27.334169 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:27.339995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.340446 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.341261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.341877 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.407106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:27.407922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:27.414118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.414562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.415404 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.415839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.511648 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-413e7ae2-d9f6-4c70-b940-a3b0988169b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 23800 microversion: 2.20 time: 0.107538 Jan 24 16:56:27.513505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 510/990] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:27 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 23800 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:27.534120 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-cc77b773-ecc7-4e48-adab-0d52b316853d req-95c5723e-90b4-477f-bf8c-39c2c2213eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:27.536935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:27.536935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:27.547904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-cc77b773-ecc7-4e48-adab-0d52b316853d req-95c5723e-90b4-477f-bf8c-39c2c2213eaa service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.548680 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-cc77b773-ecc7-4e48-adab-0d52b316853d req-95c5723e-90b4-477f-bf8c-39c2c2213eaa service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.561053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:27.563560 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-cc77b773-ecc7-4e48-adab-0d52b316853d req-95c5723e-90b4-477f-bf8c-39c2c2213eaa service nova] Creating event network-changed:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 16:56:27.569384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-cc77b773-ecc7-4e48-adab-0d52b316853d req-95c5723e-90b4-477f-bf8c-39c2c2213eaa service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041370 Jan 24 16:56:27.570542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 511/991] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:27.576715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-023a6fa0-e1c9-4db0-a8c8-ee02e2c3f334 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1455 microversion: 2.1 time: 0.246449 Jan 24 16:56:27.577587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 481/992] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:27 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1455 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:27.596316 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:27.597160 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:27.603975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.604435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.605228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.605668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.636813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:27.638250 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] [instance: 6586b895-689e-45ea-a639-70c04b5ddbc7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:27.646948 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.647790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.648847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:27.649499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:27.665054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] HTTP exception thrown: Instance 6586b895-689e-45ea-a639-70c04b5ddbc7 could not be found. Jan 24 16:56:27.666179 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Returning 404 to user: Instance 6586b895-689e-45ea-a639-70c04b5ddbc7 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:56:27.667276 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6a132ee6-d821-4b18-a3b8-d4238baee572 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7" status: 404 len: 111 microversion: 2.1 time: 0.036767 Jan 24 16:56:27.668054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 482/993] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:27 2022] GET /compute/v2.1/servers/6586b895-689e-45ea-a639-70c04b5ddbc7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:56:27.677529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b4647779-e6fb-4705-8b6f-aa6546d19ae5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] Calling method '.version_select at 0x7fba14ce0dc0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:27.697607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b4647779-e6fb-4705-8b6f-aa6546d19ae5 tempest-TestMinimumBasicScenario-1406821518 tempest-TestMinimumBasicScenario-1406821518-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-176443666" status: 202 len: 0 microversion: 2.1 time: 0.025077 Jan 24 16:56:27.701212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 483/994] 10.222.0.117 () {58 vars in 1273 bytes} [Mon Jan 24 16:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-176443666 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:27.992697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:28.009602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4085b58f-ad2b-4289-9a48-b7edb55a0efd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1455 microversion: 2.1 time: 0.416536 Jan 24 16:56:28.012981 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 512/995] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:27 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1455 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:28.101760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:28.102433 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:28.121892 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:28.123070 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:28.123983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:28.125606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:28.327337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:28.345232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-d7cb07d3-3fbf-41c6-a8ee-e1a6d7dd8a5b req-cb209094-0b7c-446a-bb9e-73d4de2bbac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c5d45c-1da7-4563-ac75-ae5d1dc892ec", "name": "network-vif-deleted", "tag": "0ca8e31f-a171-49fb-ae74-f6d668a389a9"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:28.348171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:28.348171 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:56:28.350156 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-411b9a7b-343c-47c8-9190-c5ba7894e1c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 200 len: 1612 microversion: 2.1 time: 0.252476 Jan 24 16:56:28.351756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 484/996] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:28 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 1612 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:28.372366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d7cb07d3-3fbf-41c6-a8ee-e1a6d7dd8a5b req-cb209094-0b7c-446a-bb9e-73d4de2bbac8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:28.373603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d7cb07d3-3fbf-41c6-a8ee-e1a6d7dd8a5b req-cb209094-0b7c-446a-bb9e-73d4de2bbac8 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:28.435310 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-d7cb07d3-3fbf-41c6-a8ee-e1a6d7dd8a5b req-cb209094-0b7c-446a-bb9e-73d4de2bbac8 service nova] Creating event network-vif-deleted:0ca8e31f-a171-49fb-ae74-f6d668a389a9 for instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec on hv-cinder-82611 Jan 24 16:56:28.454013 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-d7cb07d3-3fbf-41c6-a8ee-e1a6d7dd8a5b req-cb209094-0b7c-446a-bb9e-73d4de2bbac8 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112675 Jan 24 16:56:28.461319 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 513/997] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:28.524392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:28.525814 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:28.533596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:28.534047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:28.534882 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:28.541739 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:28.646999 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3ae86b1c-d486-462e-9dcc-eebe527808c0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 25325 microversion: 2.20 time: 0.126083 Jan 24 16:56:28.651389 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 485/998] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:28 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 25325 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:29.370128 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:29.372042 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:29.382870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:29.383566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:29.384539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:29.385119 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:29.400116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. Jan 24 16:56:29.400961 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:56:29.401973 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-80148ed1-6f86-4722-bcc5-374079674000 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 404 len: 111 microversion: 2.1 time: 0.037162 Jan 24 16:56:29.403052 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 514/999] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:29 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 16:56:29.411846 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-73f674b5-ddb6-4afe-a2bf-9d12ebec835f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '.version_select at 0x7fba14ce0ca0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:29.432872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-73f674b5-ddb6-4afe-a2bf-9d12ebec835f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022503484" status: 202 len: 0 microversion: 2.1 time: 0.024997 Jan 24 16:56:29.433640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 486/1000] 10.222.0.117 () {58 vars in 1225 bytes} [Mon Jan 24 16:56:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022503484 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:29.668952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:29.670388 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:29.679043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:29.682486 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:29.683405 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:29.684004 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:29.784546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6d45e0be-3c89-432e-81c8-6d6963e4bc19 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 26626 microversion: 2.20 time: 0.123702 Jan 24 16:56:29.786351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 515/1001] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:29 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 26626 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:30.795821 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:30.797584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:30.804888 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:30.805544 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:30.806533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:30.807165 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:30.904725 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-708749fd-f243-4343-9d7c-d93240948a0c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 27489 microversion: 2.20 time: 0.112543 Jan 24 16:56:30.910499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 487/1002] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:30 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 27489 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:30.926143 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: .version_select at 0x7fba14d00700>, body: {"keypair": {"name": "tempest-keypair-911219173"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:30.942955 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:56:30.948241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:56:31.048038 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:56:31.053291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'key_pairs'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:56:31.079365 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0964157b-0cd9-4ec5-accd-2b4b9db5cdd2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.157635 Jan 24 16:56:31.081471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 516/1003] 10.222.0.117 () {60 vars in 1162 bytes} [Mon Jan 24 16:56:30 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:31.154920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-0d8e82e9-e0ca-4e5d-b2de-7d7a39c3b74f req-254ec34a-6cd6-42d9-8dad-7b9fec1d0b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921adf61-2d82-49af-8dd2-dd2fbbd585b4", "tag": "41d7d71d-3e7f-44e5-9394-f4d62e1f557f"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:31.154920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:31.154920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:31.161943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0d8e82e9-e0ca-4e5d-b2de-7d7a39c3b74f req-254ec34a-6cd6-42d9-8dad-7b9fec1d0b7b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:31.162405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0d8e82e9-e0ca-4e5d-b2de-7d7a39c3b74f req-254ec34a-6cd6-42d9-8dad-7b9fec1d0b7b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:31.175340 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-0d8e82e9-e0ca-4e5d-b2de-7d7a39c3b74f req-254ec34a-6cd6-42d9-8dad-7b9fec1d0b7b service nova] Creating event network-changed:41d7d71d-3e7f-44e5-9394-f4d62e1f557f for instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 on hv-cinder-82611 Jan 24 16:56:31.180659 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-0d8e82e9-e0ca-4e5d-b2de-7d7a39c3b74f req-254ec34a-6cd6-42d9-8dad-7b9fec1d0b7b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035401 Jan 24 16:56:31.185618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 488/1004] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:31.918409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:31.919848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:31.933334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:31.934483 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:31.935797 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:31.939348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:32.054880 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-74c397fd-8930-46d0-9c5f-cb0e6a65f009 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 27916 microversion: 2.20 time: 0.140764 Jan 24 16:56:32.057387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 517/1005] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:31 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 27916 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:33.070470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:33.072278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:33.081884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:33.082484 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:33.083881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:33.084413 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:33.102359 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2133856685", "imageRef": "eb2f16b2-6b64-43be-8240-bf30ff165a28", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2be75c4f-241a-4241-8df3-f6088625575c"}], "security_groups": [{"name": "tempest-securitygroup--2010613327"}], "key_name": "tempest-keypair-911219173", "user_data": "}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:33.190909 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fc18b32a-840c-4d09-8a20-e770b0c3caf1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28209 microversion: 2.20 time: 0.125460 Jan 24 16:56:33.191594 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 489/1006] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:33 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28209 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:33.215228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.network.neutron [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] validate_networks() for [('2be75c4f-241a-4241-8df3-f6088625575c', None, None, None, None, None)] {{(pid=127827) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:56:33.629325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Flavor limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:56:33.629749 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Image limits 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:56:33.630224 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Flavor pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:56:33.630634 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Image pref 0:0:0 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:56:33.631081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.virt.hardware [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127827) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:56:33.639551 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:33.640003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:33.641956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:33.642395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:33.659861 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for project 24a57596de944ff6b3c322128a836000. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:56:33.663714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.quota [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Getting quotas for user edb10d68444a4c6e947c1e356987736f and project 24a57596de944ff6b3c322128a836000. Resources: {'cores', 'instances', 'ram'} {{(pid=127827) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:56:33.674918 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Going to run 1 instances... {{(pid=127827) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:56:33.677610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb2f16b2-6b64-43be-8240-bf30ff165a28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127827) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:56:33.722825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [ec90395b-8990-40a8-ac30-70af3e813026] AMQP server on 10.222.0.117:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 24 16:56:34.205161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:34.206222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:34.214004 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:34.214704 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:34.215533 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:34.215970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:34.441669 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6bb5cbc2-1df3-402d-9586-7bfbf599b198 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28234 microversion: 2.20 time: 0.242705 Jan 24 16:56:34.445457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 490/1007] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:34 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28234 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:34.731841 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [ec90395b-8990-40a8-ac30-70af3e813026] Reconnected to AMQP server on 10.222.0.117:5672 via [amqp] client with port 44896. Jan 24 16:56:34.736377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4d69f1e8-7597-453b-823c-f3cf02bab585 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.638550 Jan 24 16:56:34.743291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 518/1008] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:56:33 2022] POST /compute/v2.1/servers => generated 404 bytes in 1646 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jan 24 16:56:34.747983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4d21dc8d-d5e3-459e-a493-e5b33f5cd8f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:34.748767 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4d21dc8d-d5e3-459e-a493-e5b33f5cd8f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:34.851347 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-4d21dc8d-d5e3-459e-a493-e5b33f5cd8f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:34.858505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4d21dc8d-d5e3-459e-a493-e5b33f5cd8f9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1241 microversion: 2.1 time: 0.114701 Jan 24 16:56:34.862881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 491/1009] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:34 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1241 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:56:35.454575 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:35.455586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:35.462732 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:35.463217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:35.464009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:35.464447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:35.554929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c7354931-1a68-4763-8ace-70ae5aa1ebc6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28500 microversion: 2.20 time: 0.105121 Jan 24 16:56:35.555581 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 519/1010] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:35 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28500 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:35.876872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:35.877588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:35.887472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:35.888283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:35.889097 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:35.889703 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:36.001653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:36.013930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e4b6050f-1ef1-4099-94ed-0b3804bf969d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1301 microversion: 2.1 time: 0.141181 Jan 24 16:56:36.015957 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 492/1011] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:35 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1301 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:36.567963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:36.568976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:36.575904 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:36.576358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:36.577340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:36.578635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:36.672597 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0a7c9085-e67f-484c-8562-de76f8e87776 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28668 microversion: 2.20 time: 0.107801 Jan 24 16:56:36.676705 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 520/1012] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:36 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28668 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:37.035223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:37.036406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:37.048003 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:37.048664 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:37.049472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:37.054738 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:37.251246 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:37.258714 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c0ba612f-ef4b-4b4c-819a-1b4096a737e6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.230271 Jan 24 16:56:37.259514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 493/1013] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:37 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:37.686268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:37.688725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:37.696066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:37.696592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:37.697422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:37.697860 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:37.730553 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-3977ee1f-996a-4756-8b41-daa74d3a9c81 req-0fc35009-1580-4fc9-a888-7b3e4ecd8d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67bf828-807a-4965-8f63-5afb0e9a6750", "tag": "d8888aac-db3e-4a13-accf-8a758d4457a3"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:37.737494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:37.737494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:37.780174 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-3977ee1f-996a-4756-8b41-daa74d3a9c81 req-0fc35009-1580-4fc9-a888-7b3e4ecd8d71 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:37.780695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-3977ee1f-996a-4756-8b41-daa74d3a9c81 req-0fc35009-1580-4fc9-a888-7b3e4ecd8d71 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:37.797441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-261f1bc3-3e05-4745-a695-5654f5ca002f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28668 microversion: 2.20 time: 0.116480 Jan 24 16:56:37.802137 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 521/1014] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:37 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28668 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:37.805451 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-3977ee1f-996a-4756-8b41-daa74d3a9c81 req-0fc35009-1580-4fc9-a888-7b3e4ecd8d71 service nova] Creating event network-changed:d8888aac-db3e-4a13-accf-8a758d4457a3 for instance d67bf828-807a-4965-8f63-5afb0e9a6750 on hv-cinder-82611 Jan 24 16:56:37.811005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-3977ee1f-996a-4756-8b41-daa74d3a9c81 req-0fc35009-1580-4fc9-a888-7b3e4ecd8d71 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083812 Jan 24 16:56:37.813401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 494/1015] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:38.276546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:38.277271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:38.284910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:38.285364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:38.286469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:38.286794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:38.551366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:38.558682 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7555ede9-de95-4596-ad27-cc5e87b45765 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.286148 Jan 24 16:56:38.559295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 522/1016] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:38 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:38.811303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:38.812790 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:38.819300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:38.819747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:38.820525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:38.820955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:38.889129 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b8a3dde2-d627-46ed-a8bc-8012ba36305d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28668 microversion: 2.20 time: 0.082741 Jan 24 16:56:38.889831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 495/1017] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:38 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28668 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:39.575356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:39.575970 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:39.583041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:39.583484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:39.584257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:39.584688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:39.717549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:39.725237 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ea533dc3-1df6-415a-af23-91d3e78b37e4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.153609 Jan 24 16:56:39.725806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 523/1018] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:39 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:39.901870 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:39.902909 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:39.910577 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:39.911055 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:39.911846 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:39.912282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:39.979640 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b1817b60-5a85-45e0-a0f3-6ada77e284ef tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28668 microversion: 2.20 time: 0.081620 Jan 24 16:56:39.980303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 496/1019] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:39 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28668 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:40.742011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:40.742661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:40.749842 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:40.750312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:40.751091 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:40.751523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:40.878184 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:40.885325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f5ea3165-e45b-4a4b-b86b-eca29a69abd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.147091 Jan 24 16:56:40.885893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 524/1020] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:40 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:40.992298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:40.993323 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:41.000273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:41.000721 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:41.001507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:41.001946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:41.088956 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-949c7d69-b945-43c7-8a03-f1dc3d8efd9b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 28683 microversion: 2.20 time: 0.100702 Jan 24 16:56:41.089621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 497/1021] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:40 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 28683 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:41.901972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:41.902589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:41.909200 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:41.909661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:41.910497 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:41.910969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:42.018258 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-66c9e409-6d05-4c96-b327-d95ff7002d1a req-82fc32ca-beef-40a3-89f7-5103366d025b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67bf828-807a-4965-8f63-5afb0e9a6750", "name": "network-vif-plugged", "status": "completed", "tag": "d8888aac-db3e-4a13-accf-8a758d4457a3"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:42.020410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:42.020410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:42.028799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-66c9e409-6d05-4c96-b327-d95ff7002d1a req-82fc32ca-beef-40a3-89f7-5103366d025b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:42.029250 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-66c9e409-6d05-4c96-b327-d95ff7002d1a req-82fc32ca-beef-40a3-89f7-5103366d025b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:42.041943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-66c9e409-6d05-4c96-b327-d95ff7002d1a req-82fc32ca-beef-40a3-89f7-5103366d025b service nova] Creating event network-vif-plugged:d8888aac-db3e-4a13-accf-8a758d4457a3 for instance d67bf828-807a-4965-8f63-5afb0e9a6750 on hv-cinder-82611 Jan 24 16:56:42.045279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:42.055860 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-66c9e409-6d05-4c96-b327-d95ff7002d1a req-82fc32ca-beef-40a3-89f7-5103366d025b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042454 Jan 24 16:56:42.056268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dc43363e-b4c6-4da2-ac98-59b87c4f424f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.158399 Jan 24 16:56:42.057122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 525/1022] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:41 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:42.057453 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 498/1023] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:42.100521 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:42.101906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:42.109110 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:42.109663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:42.110482 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:42.110953 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:42.203563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a42d3a5a-c6c1-4aaf-8ee7-ebc809abbd25 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 30034 microversion: 2.20 time: 0.106664 Jan 24 16:56:42.204282 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 526/1024] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:42 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 30034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:43.077278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:43.079652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:43.090949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:43.090949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:43.090949 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:43.091322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:43.218936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:43.220422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:43.230293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:43.230998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:43.232192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:43.232846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:43.259100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:43.266597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-65dee7e8-d16d-4dfc-8f6d-cc4bfec9ed7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1367 microversion: 2.1 time: 0.196317 Jan 24 16:56:43.267153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 499/1025] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:43 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:43.331757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1f248a6d-ca13-4165-81a5-5b13b7954a71 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 31295 microversion: 2.20 time: 0.119700 Jan 24 16:56:43.332337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 527/1026] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:43 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 31295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:44.285123 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:44.285734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:44.292442 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.292894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.293674 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.294103 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.344532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:44.345545 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:44.352369 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.352824 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.353618 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.354061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.429433 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:44.437304 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-34a8776f-249c-448f-b845-ea7cf7026f05 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1553 microversion: 2.1 time: 0.157239 Jan 24 16:56:44.437866 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 500/1027] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:56:44 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:56:44.451076 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9eb14d5a-7df6-43de-b427-6dd455578a1e tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 32438 microversion: 2.20 time: 0.110785 Jan 24 16:56:44.451826 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 528/1028] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:44 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 32438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:44.452747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:44.453242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:44.459072 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.459516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.460290 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:44.460742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:44.538264 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c0215f73-be85-449f-9774-bf87a0e6aad2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088875 Jan 24 16:56:44.538887 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 501/1029] 10.222.0.117 () {58 vars in 1279 bytes} [Mon Jan 24 16:56:44 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:56:45.464041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:45.465621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:45.465902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:45.467113 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:45.474027 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:45.474476 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:45.474696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:45.475122 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:45.475286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:45.475847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:45.475965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:45.476280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:45.546483 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3a2adb6c-87cb-4177-bcdb-c6b3cb226944 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.084196 Jan 24 16:56:45.549705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 502/1030] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:45 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:45.552283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-82cce1d1-3716-4b40-858e-2a7cbc6df4d5 req-6f574cbc-e1c2-48c4-9951-df17f28f7088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67bf828-807a-4965-8f63-5afb0e9a6750", "tag": "d8888aac-db3e-4a13-accf-8a758d4457a3"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:45.553749 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:56:45.553749 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:56:45.562673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-82cce1d1-3716-4b40-858e-2a7cbc6df4d5 req-6f574cbc-e1c2-48c4-9951-df17f28f7088 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:45.563155 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-82cce1d1-3716-4b40-858e-2a7cbc6df4d5 req-6f574cbc-e1c2-48c4-9951-df17f28f7088 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:45.567064 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fd45fbe6-84fa-4163-a855-d650f1945deb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 33262 microversion: 2.20 time: 0.106830 Jan 24 16:56:45.568448 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 529/1031] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:45 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 33262 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:45.574945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-82cce1d1-3716-4b40-858e-2a7cbc6df4d5 req-6f574cbc-e1c2-48c4-9951-df17f28f7088 service nova] Creating event network-changed:d8888aac-db3e-4a13-accf-8a758d4457a3 for instance d67bf828-807a-4965-8f63-5afb0e9a6750 on hv-cinder-82611 Jan 24 16:56:45.580837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-82cce1d1-3716-4b40-858e-2a7cbc6df4d5 req-6f574cbc-e1c2-48c4-9951-df17f28f7088 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032425 Jan 24 16:56:45.581427 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 503/1032] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:56:46.557786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:46.558819 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:46.566323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:46.566799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:46.567582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:46.568036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:46.579789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:46.580885 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:46.587234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:46.587758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:46.588618 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:46.589125 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:46.646077 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-821ff4b5-30ae-42f8-b836-616cf06abffb tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.092262 Jan 24 16:56:46.646698 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 530/1033] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:46 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:46.683005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ef966839-69f6-475c-93bd-240a5108ae77 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 33860 microversion: 2.20 time: 0.108132 Jan 24 16:56:46.683634 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 504/1034] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:46 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 33860 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:47.657612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:47.658632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:47.665691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:47.666150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:47.666968 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:47.667413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:47.696001 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:47.696994 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:47.703835 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:47.704283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:47.705060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:47.705490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:47.744372 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9cc5c678-cb3f-4769-a33c-3a61d81d9de2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.090858 Jan 24 16:56:47.745071 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 531/1035] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:47 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:47.788657 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-031def0f-c82f-45a4-8610-1531eb136c95 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 34657 microversion: 2.20 time: 0.096514 Jan 24 16:56:47.789319 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 505/1036] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:47 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 34657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:48.755958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:48.756898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:48.763825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:48.765109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:48.765905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:48.766345 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:48.801058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:48.802061 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:48.808869 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:48.809324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:48.810106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:48.810542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:48.833061 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-fdbc0cf4-2bc7-472a-8d01-a90f0323f93a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.081368 Jan 24 16:56:48.836180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 532/1037] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:48 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:48.893136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ad5588c2-f0ee-40f9-8c61-a79485020d3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 35526 microversion: 2.20 time: 0.096222 Jan 24 16:56:48.894013 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 506/1038] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:48 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 35526 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:49.845471 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:49.846484 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:49.853375 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:49.853829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:49.854615 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:49.855082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:49.906157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:49.907197 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:49.914255 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:49.914709 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:49.915524 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:49.915962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:49.923894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-10acc722-4ba2-4e19-994e-01a7e15809d8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.083518 Jan 24 16:56:49.924935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 533/1039] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:49 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:50.003646 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c32963ed-38a9-4721-b9c7-7ae0f4a40c23 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 36581 microversion: 2.20 time: 0.102200 Jan 24 16:56:50.004498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 507/1040] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:49 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 36581 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:50.936134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:50.937247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:50.944069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:50.944515 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:50.945293 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:50.945727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:51.016606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:51.017641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:51.023750 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2c23ecbf-bda8-4234-ab0d-b6f16611c588 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.092006 Jan 24 16:56:51.024562 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 534/1041] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:50 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:51.024685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:51.025023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:51.025810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:51.026244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:51.112792 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-89befcf2-393d-476b-9e01-775023d81848 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 37587 microversion: 2.20 time: 0.100831 Jan 24 16:56:51.113443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 508/1042] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:51 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 37587 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:52.037278 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:52.038799 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:52.047644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:52.048101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:52.048932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:52.049371 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:52.121624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0e8fc614-7de3-4131-bac3-007fdd4374b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.090440 Jan 24 16:56:52.122376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 535/1043] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:52 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:56:52.125225 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:52.126233 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:52.133240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:52.133695 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:52.134485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:52.134951 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:52.233720 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b0bba94d-edd6-42db-a08d-046823596800 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 38207 microversion: 2.20 time: 0.112930 Jan 24 16:56:52.234707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 509/1044] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:52 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 38207 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 24 16:56:53.133749 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:53.134893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:53.143187 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:53.143643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:53.144459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:53.144898 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:53.214994 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0c5b8b2e-26ab-43ad-b718-2d6eaedc6c74 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.085352 Jan 24 16:56:53.215637 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 536/1045] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:53 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:53.246118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:53.247146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:53.255090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:53.255538 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:53.256316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:53.256758 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:53.332513 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-3d05acf3-6632-453a-9f41-fbab3da696d6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 38207 microversion: 2.20 time: 0.090410 Jan 24 16:56:53.333145 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 510/1046] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:53 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 38207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:54.226830 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:54.227835 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:54.235084 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:54.235533 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:54.236315 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:54.236749 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:54.300036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-51bec98e-d30a-4968-aed0-1fa4cea9997e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.076925 Jan 24 16:56:54.300643 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 537/1047] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:54 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:54.345503 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:54.346506 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:54.353369 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:54.353823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:54.354609 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:54.355072 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:54.420684 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-57be36f7-c0f1-4bb0-8a2f-938d3206d026 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 38207 microversion: 2.20 time: 0.079546 Jan 24 16:56:54.421511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 511/1048] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:54 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 38207 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:55.312603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:55.313615 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:55.320104 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.320563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.321352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.321794 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.390852 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8566b1e9-183b-4e5f-9567-56c2005b8f7f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.083414 Jan 24 16:56:55.391463 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 538/1049] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:55 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:55.432667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:55.433699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:55.440822 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.441275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.442058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.442502 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.521408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-731daa7a-e926-4336-bdac-915437414957 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 200 len: 38348 microversion: 2.20 time: 0.092669 Jan 24 16:56:55.522336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 512/1050] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:55 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 38348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:56:55.533036 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:55.533657 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:55.541230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.541684 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.542481 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:55.542965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:55.567102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2d7816bd-a070-4341-8d50-f4821230852c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/ips" status: 200 len: 151 microversion: 2.20 time: 0.038836 Jan 24 16:56:55.567670 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 539/1051] 10.222.0.117 () {60 vars in 1293 bytes} [Mon Jan 24 16:56:55 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:56:56.402270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:56.403310 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:56.411532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:56.411923 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:56.412711 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:56.413151 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:56.483654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0cce390a-8d05-4a01-903f-9d9a6e4e13fe tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.085313 Jan 24 16:56:56.484309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 513/1052] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:56 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:57.493538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:57.494368 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:57.500997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:57.501435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:57.502212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:57.502647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:57.566778 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-32620a87-420d-4bf4-bc55-3f6efa175d7b tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.076925 Jan 24 16:56:57.567425 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 540/1053] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:57 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:56:57.731705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:57.732970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:57.739824 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:57.740275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:57.741053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:57.741487 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:57.764449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lazy-loading 'flavor' on Instance uuid f078fbc1-030c-4caf-9999-d2810f26d0bc {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:56:58.015842 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5bb99b44-9d98-4356-8048-1401e705dc08 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 202 len: 0 microversion: 2.20 time: 0.287901 Jan 24 16:56:58.016437 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 514/1054] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:56:57 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:56:58.024734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:58.025431 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:58.033151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:58.033681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:58.034466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:58.034931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:58.171921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:58.179975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:58.181478 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:58.182624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-59719a98-e5eb-4820-a5a1-d891ccee0ead tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.161938 Jan 24 16:56:58.183222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 541/1055] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:58 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:58.579947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:58.580932 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:58.587142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:58.587587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:58.588357 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:58.588788 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:58.648584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-08e62403-cc5c-404f-ad76-0bbb60f74129 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14 microversion: 2.1 time: 0.074471 Jan 24 16:56:58.649201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 515/1056] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:58 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 24 16:56:59.202235 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:56:59.202858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:59.212359 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:59.213018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:59.214219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:59.214919 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:59.351216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:59.359029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:59.360509 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:56:59.361655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0526db81-3e09-47dd-a303-c06bba16de9d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.163474 Jan 24 16:56:59.362228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 542/1057] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:56:59 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:56:59.660399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:56:59.661436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:56:59.668295 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:59.668753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:59.669554 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:56:59.669994 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:56:59.753797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a41681d2-d389-4dca-b3b4-3a202a92cab2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 8392 microversion: 2.1 time: 0.097210 Jan 24 16:56:59.755293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 516/1058] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:56:59 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 8392 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:57:00.379456 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:00.380101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:00.386358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:00.386838 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:00.387622 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:00.388062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:00.517606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:00.525209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:00.526691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:00.527870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-64e7b2d3-8f31-4972-8de4-316906a659dd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.152148 Jan 24 16:57:00.528426 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 543/1059] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:00 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:00.765598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:00.766518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:00.773341 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:00.773788 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:00.774571 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:00.775023 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:00.868274 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1264a1af-f2ea-4468-940a-9b6e1f572e0f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 14890 microversion: 2.1 time: 0.106855 Jan 24 16:57:00.868909 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 517/1060] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:00 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 14890 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:01.546543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:01.547169 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:01.553800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:01.554148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:01.554980 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:01.555422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:01.686413 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:01.694057 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:01.695569 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:01.696714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-14068e57-fd28-4f15-9045-10ad7368b5b1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.154173 Jan 24 16:57:01.697273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 544/1061] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:01 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:01.880082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:01.881014 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:01.887843 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:01.888370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:01.889145 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:01.889578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:01.973523 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d8d64098-e47f-46e7-8d47-66143ea6ab97 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 17984 microversion: 2.1 time: 0.097391 Jan 24 16:57:01.974143 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 518/1062] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:01 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 17984 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:02.714592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:02.715229 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:02.722034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:02.722480 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:02.723292 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:02.723729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:02.850846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:02.859124 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:02.860608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:02.861753 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9dd439dd-3bef-4855-b54d-ffa8c1b70199 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.150923 Jan 24 16:57:02.862311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 545/1063] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:02 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:02.986035 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:02.987015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:02.993840 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:02.994293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:02.995117 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:02.995555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:03.066473 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b7429eb7-7441-468d-8da9-b4dcc49100fd tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 17984 microversion: 2.1 time: 0.085120 Jan 24 16:57:03.067103 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 519/1064] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:02 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 17984 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:03.879631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:03.880197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:03.886363 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:03.886845 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:03.887629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:03.888070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:04.021321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:04.029130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:04.030628 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:04.031810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-74f6276d-687e-4b19-9180-9eaca51cce17 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.155976 Jan 24 16:57:04.032370 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 546/1065] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:03 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:04.077676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:04.078677 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:04.085495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:04.085947 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:04.086731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:04.087191 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:04.176764 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-50193198-7965-49f1-8e67-d77c6adeff07 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 19342 microversion: 2.1 time: 0.102948 Jan 24 16:57:04.177471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 520/1066] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:04 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:05.049324 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:05.049936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:05.056289 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:05.056744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:05.057532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:05.057972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:05.187082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:05.189030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:05.190047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:05.195109 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:05.196702 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:05.196834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:05.197282 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:05.198070 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5fc9c0d3-5cdd-4e91-b450-dd03038af51a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.152749 Jan 24 16:57:05.198193 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:05.198509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:05.199025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 547/1067] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:05 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:05.292039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-366c6221-add7-447f-8d2e-1689d90cf678 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 21840 microversion: 2.1 time: 0.107390 Jan 24 16:57:05.292697 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 521/1068] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:05 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 21840 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:06.217400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:06.218008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:06.224296 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:06.224749 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:06.225538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:06.225983 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:06.304593 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:06.305779 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:06.312961 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:06.313416 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:06.314213 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:06.314653 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:06.355314 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:06.363283 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:06.364771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:06.365914 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-df6f7bc2-1d57-43f9-9ead-690623a04ea7 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.153018 Jan 24 16:57:06.366467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 548/1069] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:06 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:06.389561 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ca61ee88-c92b-4f0f-b7ae-ce8e6763a174 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 23137 microversion: 2.1 time: 0.088557 Jan 24 16:57:06.390215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 522/1070] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:06 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 23137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:07.383660 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:07.384267 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:07.390959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:07.391356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:07.392136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:07.392575 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:07.401644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:07.402687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:07.410709 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:07.411127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:07.411955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:07.412399 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:07.508344 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f776b915-ec4d-4772-ab61-fe71cddba7fa tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 24016 microversion: 2.1 time: 0.110605 Jan 24 16:57:07.509293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 523/1071] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:07 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 24016 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:07.530142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:07.537907 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:07.539453 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:07.540617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-75a8b3af-7ecb-49cb-a0c9-712108306d07 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.160589 Jan 24 16:57:07.541176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 549/1072] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:07 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:08.520357 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:08.521297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:08.528929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:08.529388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:08.530180 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:08.530616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:08.560371 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:08.561045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:08.567590 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:08.568039 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:08.568821 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:08.569261 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:08.615030 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5d50957c-264e-4a2c-93cd-ea756b6028f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 25178 microversion: 2.1 time: 0.098658 Jan 24 16:57:08.618734 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 524/1073] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:08 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 25178 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:08.697840 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:08.706069 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:08.707602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:08.708766 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-07cd6e3e-7cd0-472e-b631-59af7d8d16c3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.153174 Jan 24 16:57:08.709335 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 550/1074] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:08 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:09.626370 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:09.627388 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:09.634210 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:09.634656 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:09.635460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:09.635890 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:09.716900 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-057ed514-1559-4f2b-8486-cbfcda9846f7 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 26275 microversion: 2.1 time: 0.093794 Jan 24 16:57:09.717528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 525/1075] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:09 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 26275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:09.727005 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:09.727612 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:09.735254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:09.735711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:09.736492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:09.736930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:09.868725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:09.876366 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:09.877906 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:09.879021 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-82154eff-f668-44a2-a90a-915fe6fb84c4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.155681 Jan 24 16:57:09.879582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 551/1076] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:09 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:10.728689 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:10.729715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:10.736604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:10.737060 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:10.737849 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:10.738268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:10.825586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c9579386-06b2-4e07-aaeb-12fb2095e958 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 27131 microversion: 2.1 time: 0.100244 Jan 24 16:57:10.826118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 526/1077] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:10 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 27131 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:10.897144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:10.897747 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:10.904674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:10.905120 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:10.905888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:10.906322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:11.043673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:11.051801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:11.053287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:11.054430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-df4498b6-30ee-4735-ae34-63cd9f02c72d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.161012 Jan 24 16:57:11.055047 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 552/1078] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:10 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:11.837571 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:11.838573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:11.846542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:11.847042 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:11.847836 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:11.848264 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:11.933266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a2363bb2-1df6-4109-a35a-2b68db21eabf tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 27647 microversion: 2.1 time: 0.099660 Jan 24 16:57:11.933897 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 527/1079] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:11 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 27647 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:12.072609 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:12.073228 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:12.080252 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:12.080709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:12.081501 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:12.081946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:12.213858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:12.221948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:12.223491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:12.224647 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e05892b6-8871-4a54-8d31-7b22d28d7d12 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.155792 Jan 24 16:57:12.225200 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 553/1080] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:12 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:12.945857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:12.946887 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:12.953769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:12.954216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:12.955012 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:12.955452 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:13.053235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dd854551-c1b8-46ac-a1f3-66a974049614 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 27942 microversion: 2.1 time: 0.111250 Jan 24 16:57:13.053926 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 528/1081] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:12 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 27942 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:13.243132 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:13.243665 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:13.250173 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:13.250626 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:13.251468 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:13.251913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:13.386222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:13.394676 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:13.396213 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:13.397377 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-55c86999-143b-4893-af2b-b2c50927d24f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.158091 Jan 24 16:57:13.397940 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 554/1082] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:13 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:14.065044 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:14.066059 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:14.073115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:14.073564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:14.074353 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:14.074935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:14.152431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-37af1591-7581-4b9e-9036-d0b8dba24688 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28195 microversion: 2.1 time: 0.091351 Jan 24 16:57:14.154667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 529/1083] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:14 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28195 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:14.415049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:14.415595 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:14.422381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:14.422888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:14.424254 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:14.424695 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:14.557057 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:14.565758 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:14.567297 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:14.568492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-15160ea8-ebf1-41f4-9a72-9ff45e789363 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1747 microversion: 2.20 time: 0.157332 Jan 24 16:57:14.569055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 555/1084] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:14 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:15.164607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:15.165615 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:15.173212 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:15.173936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:15.174716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:15.175181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:15.256050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-966d5dfc-9e50-46a4-b6e5-a4211df6b426 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28195 microversion: 2.1 time: 0.095286 Jan 24 16:57:15.256722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 530/1085] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:15 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28195 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:15.586417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:15.587049 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:15.593848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:15.594291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:15.595098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:15.595539 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:15.727747 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:15.736657 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:15.738140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:15.739444 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9c33d163-76c7-4ed7-8cf6-6694804728bc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1747 microversion: 2.20 time: 0.156642 Jan 24 16:57:15.740007 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 556/1086] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:15 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:16.149988 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-fb3d1475-d04d-4a0c-a06f-f1741657c8a1 req-5a152a15-085a-4828-b156-4e90153dee29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:16.155465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:57:16.155465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:57:16.164064 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-fb3d1475-d04d-4a0c-a06f-f1741657c8a1 req-5a152a15-085a-4828-b156-4e90153dee29 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:16.164573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-fb3d1475-d04d-4a0c-a06f-f1741657c8a1 req-5a152a15-085a-4828-b156-4e90153dee29 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:16.177617 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-fb3d1475-d04d-4a0c-a06f-f1741657c8a1 req-5a152a15-085a-4828-b156-4e90153dee29 service nova] Creating event network-vif-plugged:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:57:16.183298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-fb3d1475-d04d-4a0c-a06f-f1741657c8a1 req-5a152a15-085a-4828-b156-4e90153dee29 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037692 Jan 24 16:57:16.184857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 531/1087] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:16.267436 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:16.268457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:16.274514 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:16.275118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:16.275781 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:16.276225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:16.352111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-00434dc8-105d-46d6-9500-ad001d7ade2f tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28195 microversion: 2.1 time: 0.088136 Jan 24 16:57:16.353972 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 557/1088] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:16 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28195 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:16.759111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:16.760222 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:16.767724 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:16.768198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:16.769167 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:16.769854 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:16.909683 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:16.920923 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:16.922717 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:16.924297 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-e07b410f-2ad9-471a-a80c-dbaf6365883f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.170211 Jan 24 16:57:16.935279 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 532/1089] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:16 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:17.364923 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:17.365940 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:17.374622 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:17.375433 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:17.376406 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:17.377354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:17.466459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-114b7a4e-d9e7-443f-9fec-b821067ed39c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28322 microversion: 2.1 time: 0.105141 Jan 24 16:57:17.468074 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 558/1090] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:17 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:17.942702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:17.943349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:17.950162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:17.950974 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:17.952086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:17.952591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:18.108585 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:18.129744 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:18.132365 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:18.133883 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b007cfbe-c598-47be-9cbe-8de1e222e21d tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.194934 Jan 24 16:57:18.134527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 533/1091] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:17 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:18.479952 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:18.481227 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:18.488205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:18.488905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:18.489891 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:18.491271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:18.569853 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7ef1319b-eb6f-46ee-8254-58d14a16711c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28486 microversion: 2.1 time: 0.093860 Jan 24 16:57:18.570814 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 559/1092] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:18 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28486 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:19.152580 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:19.154019 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:19.161034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:19.161509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:19.162978 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:19.163426 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:19.333864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:19.343743 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:19.345281 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:19.346450 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0cd61940-57b2-4308-9b9b-21d2cfb35589 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.197636 Jan 24 16:57:19.347419 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 534/1093] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:19 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:19.583117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:19.584880 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:19.592725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:19.593435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:19.594373 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:19.594927 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:19.685727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0edbf3d5-d77e-4b8f-bf12-d44947483e50 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28654 microversion: 2.1 time: 0.106336 Jan 24 16:57:19.686788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 560/1094] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:19 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:20.364642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:20.365907 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:20.375782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:20.376526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:20.377540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:20.378138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:20.526896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:20.536017 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:20.537517 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:20.538829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a704e422-c10f-4355-9211-fb48ea18c8cf tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.177952 Jan 24 16:57:20.539384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 535/1095] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:20 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:20.698439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:20.701086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:20.708298 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:20.708937 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:20.710016 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:20.710409 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:20.776727 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-43265d9d-6f43-48ae-b342-4a143aed19c2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28654 microversion: 2.1 time: 0.082385 Jan 24 16:57:20.778644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 561/1096] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:20 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28654 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:21.557582 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:21.558857 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:21.567072 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:21.567647 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:21.568471 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:21.568936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:21.711195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:21.720945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:21.722444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:21.723667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fc6bf776-3a1c-496c-b6ef-894001314fe9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.170066 Jan 24 16:57:21.724247 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 536/1097] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:21 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:21.790058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:21.791144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:21.799236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:21.799688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:21.800508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:21.800975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:21.874574 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7809269d-7c31-4934-8c4f-4fe1b3303dd0 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 28654 microversion: 2.1 time: 0.087964 Jan 24 16:57:21.875690 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 562/1098] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:21 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 28654 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:22.742976 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:22.745245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:22.755188 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:22.755934 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:22.756933 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:22.757367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:22.892586 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:22.894340 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:22.901437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:22.902523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:22.903602 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:22.904255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:22.920922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:22.930130 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:22.932081 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:22.934264 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-89ae798c-e2e4-4678-8a6d-fc71d8e04ed5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.194338 Jan 24 16:57:22.935541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 537/1099] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:22 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:23.006162 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-292c9480-ccad-4ceb-b5e6-5d3264c44d3c tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 29126 microversion: 2.1 time: 0.121021 Jan 24 16:57:23.007814 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 563/1100] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:22 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 29126 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:23.953429 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:23.954019 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:23.960806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:23.961384 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:23.962058 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:23.962579 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:24.018693 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:24.019987 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:24.031671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:24.033514 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:24.035572 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:24.036381 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:24.117884 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:24.127045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:24.128330 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:24.129643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c0b2df88-e0fe-47d5-ad20-6445cfc0c19a tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.180671 Jan 24 16:57:24.130418 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 538/1101] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:23 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:24.142559 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dd8a8898-aa65-4d72-80f5-485cc2e3aca9 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 30951 microversion: 2.1 time: 0.127676 Jan 24 16:57:24.146807 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 564/1102] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:24 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 30951 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:25.152348 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:25.153206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:25.154954 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:25.156045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:25.162098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:25.162663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:25.163422 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:25.163656 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:25.164015 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:25.164136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:25.164911 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:25.165432 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:25.247739 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ec5f87a7-325d-41d4-a827-39d4cab8628e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 32759 microversion: 2.1 time: 0.097582 Jan 24 16:57:25.249037 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 565/1103] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:25 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 32759 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:25.312588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:25.320443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:25.322076 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:25.323288 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-00403d02-6277-49ec-9e7f-9717fa1d0d79 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1742 microversion: 2.20 time: 0.175981 Jan 24 16:57:25.324865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 539/1104] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:25 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:26.260233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:26.261939 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:26.268786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:26.269239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:26.270220 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:26.270666 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:26.342479 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-688b2bf8-cb6c-444a-b0ec-794b41f13713 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 33514 microversion: 2.1 time: 0.086229 Jan 24 16:57:26.342844 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:26.346831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:26.346960 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 566/1105] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:26 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 33514 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:26.349937 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:26.350386 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:26.351205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:26.351644 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:26.486316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:26.494071 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:26.496292 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:26.497541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a7a62095-f388-47ec-81fa-7303ee7b8bb2 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1724 microversion: 2.20 time: 0.158911 Jan 24 16:57:26.498098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 540/1106] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:26 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:27.354028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:27.355945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:27.362931 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:27.363383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:27.364163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:27.364600 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:27.438241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d23c53ff-05f2-4dba-a8f4-7dad1752aee6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 34332 microversion: 2.1 time: 0.088100 Jan 24 16:57:27.438820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 567/1107] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:27 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 34332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:27.516425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:27.517036 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:27.523358 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:27.523815 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:27.524604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:27.525047 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:27.653280 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:27.660990 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:27.662494 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:27.663668 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a785f241-bf8a-4834-a75c-cc507559ee1b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1724 microversion: 2.20 time: 0.151163 Jan 24 16:57:27.664235 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 541/1108] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:27 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:28.164028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-6ffd92eb-2836-4530-bc01-db2b31d2a6f4 req-de1f450e-12a8-4d77-9277-34ed0c6e4934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "name": "network-vif-unplugged", "status": "completed", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:28.165704 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:57:28.165704 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:57:28.175066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-6ffd92eb-2836-4530-bc01-db2b31d2a6f4 req-de1f450e-12a8-4d77-9277-34ed0c6e4934 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.175811 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-6ffd92eb-2836-4530-bc01-db2b31d2a6f4 req-de1f450e-12a8-4d77-9277-34ed0c6e4934 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.189360 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-6ffd92eb-2836-4530-bc01-db2b31d2a6f4 req-de1f450e-12a8-4d77-9277-34ed0c6e4934 service nova] Creating event network-vif-unplugged:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:57:28.194150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-6ffd92eb-2836-4530-bc01-db2b31d2a6f4 req-de1f450e-12a8-4d77-9277-34ed0c6e4934 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034149 Jan 24 16:57:28.194783 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 568/1109] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:28.449596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:28.450485 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:28.456382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.456831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.457610 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.458044 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.532138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-565406fa-cc31-41bb-a0e0-7affd43b5d43 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 35177 microversion: 2.1 time: 0.086119 Jan 24 16:57:28.532921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 542/1110] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:28 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 35177 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:28.682197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:28.682935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:28.689120 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.689571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.690352 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.690814 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.820205 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:28.828526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:28.830008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:28.831174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-caa8fef2-b3c0-4b99-9464-1773061df3de tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1667 microversion: 2.20 time: 0.153474 Jan 24 16:57:28.831731 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 569/1111] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:28 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:28.849698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03bb0419-22a7-4f95-aaf2-269c44580a77"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:28.850957 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:28.857970 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.858423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:28.859239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:28.859677 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.108551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-eaf22c22-93e6-49da-ba5a-0171709f2da6 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.262747 Jan 24 16:57:29.109326 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 543/1112] 10.222.0.117 () {62 vars in 1368 bytes} [Mon Jan 24 16:57:28 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments => generated 188 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:29.220856 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:29.221356 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:29.227322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.227773 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.228557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.229026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.456936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d59c73ca-29f2-405d-924e-a3ece25f49bd tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments/03bb0419-22a7-4f95-aaf2-269c44580a77" status: 202 len: 0 microversion: 2.20 time: 0.239902 Jan 24 16:57:29.457524 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 570/1113] 10.222.0.117 () {60 vars in 1461 bytes} [Mon Jan 24 16:57:29 2022] DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments/03bb0419-22a7-4f95-aaf2-269c44580a77 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:57:29.512990 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:29.513616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:29.520975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.521432 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.522230 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.522687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.544344 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:29.545458 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:29.552784 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.553236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.554026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.554466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.609941 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f62f379f-7603-40d9-b766-3b29c8744e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action" status: 202 len: 0 microversion: 2.20 time: 0.101233 Jan 24 16:57:29.610804 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 544/1114] 10.222.0.117 () {62 vars in 1323 bytes} [Mon Jan 24 16:57:29 2022] POST /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:57:29.618045 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:29.618654 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:29.625241 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.625775 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.628266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:29.628266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:29.638337 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7398ebd7-22ec-4afa-9f19-7a5d9e70541a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 36401 microversion: 2.1 time: 0.097659 Jan 24 16:57:29.642567 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 571/1115] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:29 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 36401 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 24 16:57:29.765423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:29.773402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:29.775106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:29.776387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b603f3ed-85b4-41ab-9717-c7bb54244731 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1675 microversion: 2.20 time: 0.161915 Jan 24 16:57:29.777100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 545/1116] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:29 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:30.650163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:30.651424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:30.658887 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:30.659342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:30.660136 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:30.660576 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:30.736051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6de54275-d9cf-4f71-8658-e3d38bb09e76 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 37763 microversion: 2.1 time: 0.089808 Jan 24 16:57:30.736697 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 572/1117] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:30 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 37763 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:30.795077 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:30.795692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:30.802401 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:30.802894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:30.803682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:30.804126 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:30.936309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:30.944300 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:30.945807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:30.946993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8b82076c-2e19-4fe2-b211-1a6045e624f3 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.156081 Jan 24 16:57:30.947592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 546/1118] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:30 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:31.750032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:31.752134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:31.759446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:31.760243 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:31.761881 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:31.762403 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:31.966140 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:31.967468 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:31.973848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:31.974413 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:31.975335 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:31.975871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:32.129074 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:32.144903 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:32.148978 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:32.153623 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-804cb30f-6e5c-4675-b750-87839d2de6aa tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.189625 Jan 24 16:57:32.154685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 547/1119] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:31 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:33.174677 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:33.175649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:33.183428 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:33.184189 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:33.185031 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:33.185521 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:33.323526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:33.331540 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:33.333040 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:33.334215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-60780ca7-04d9-4833-a531-4c76337ae93b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.164541 Jan 24 16:57:33.334799 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 548/1120] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:33 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:34.352546 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:34.354011 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:34.361489 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:34.362033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:34.362966 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:34.363515 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:34.498643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:34.507516 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:34.509239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:34.510687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6a4e139e-97a8-46b2-ad76-179bbf4faf05 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.161944 Jan 24 16:57:34.521995 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 549/1121] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:34 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:35.530563 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:35.531294 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:35.538086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:35.538541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:35.539363 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:35.539806 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:35.707552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:35.716929 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:35.718470 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:35.719848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0839f75d-97f2-4536-9462-bf32ae0145b9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.194371 Jan 24 16:57:35.731207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 550/1122] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:35 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:36.748776 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:36.749464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:36.756560 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:36.757100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:36.758089 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:36.758588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:36.898346 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:36.908261 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:36.909844 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:36.911048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-574ae880-a787-4163-958b-c73802242ccc tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.166513 Jan 24 16:57:36.915238 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 551/1123] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:36 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:37.941112 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:37.946110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:37.993039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:37.996619 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:38.036938 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:38.036938 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:38.170803 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:38.179528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:38.181110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:38.182627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fe5ce35e-fe81-4e9c-88c0-c8a3bc6c9af5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.253815 Jan 24 16:57:38.196593 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 552/1124] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:37 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:39.201853 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:39.202614 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:39.210402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:39.210872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:39.211661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:39.212096 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:39.345759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:39.354531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:39.356079 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:39.357240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-06ad5b9b-ad24-42ef-98a6-fa36d0107a30 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.159681 Jan 24 16:57:39.357881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 553/1125] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:39 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 24 16:57:39.913938 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-24f4dede-e9b3-493e-8087-56fb44474ac4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action" status: 200 len: 38320 microversion: 2.1 time: 8.169004 Jan 24 16:57:39.914588 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 573/1126] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:57:31 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/action => generated 38320 bytes in 8171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 24 16:57:39.925118 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:39.925691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:39.931663 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:39.932694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:39.933493 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:39.933932 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:39.957945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-70c2965b-77ab-464f-b12a-71d2203c2ff5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/ips" status: 200 len: 145 microversion: 2.1 time: 0.036732 Jan 24 16:57:39.958536 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 554/1127] 10.222.0.117 () {58 vars in 1252 bytes} [Mon Jan 24 16:57:39 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:40.376055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:40.376754 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:40.384025 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:40.384532 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:40.385905 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:40.386354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:40.607761 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:40.617113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:40.618691 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:40.620670 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-0201bfac-fb99-44c8-bf12-03bedbdc9eeb tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.248609 Jan 24 16:57:40.621246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 574/1128] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:40 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:41.312686 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e17828a-4f77-407e-aa30-4d105eb2d0d8"}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:41.313792 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:41.320062 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:41.320511 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:41.321286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:41.321718 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:41.544555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-86dc4672-3af0-41c3-8ad6-d7049b67bc06 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.236244 Jan 24 16:57:41.545171 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 555/1129] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:57:41 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 194 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:41.643948 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:41.644583 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:41.650667 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:41.652111 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:41.656214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:41.656214 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:41.794998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:41.803348 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:41.805346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:41.807022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-296608e2-e285-40df-9c38-6151eda000ce tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.166573 Jan 24 16:57:41.808233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 575/1130] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:41 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:42.828133 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:42.828845 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:42.834971 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:42.835413 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:42.836186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:42.836617 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:42.985240 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:42.993046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:42.994542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:42.996900 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6f339112-f9fe-41bf-b77f-00de333ba5f5 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.174018 Jan 24 16:57:42.997700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 556/1131] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:42 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:44.014706 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:44.015273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:44.021506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:44.021949 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:44.022777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:44.023202 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:44.157055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:44.165882 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:44.167889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:44.169153 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-58e7a6f0-9f4c-4abb-94b0-1648a38ecab4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.158361 Jan 24 16:57:44.169936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 576/1132] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:44 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:44.334002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-1946a897-4ab6-4419-80ea-148a98fced5e req-ebb81c8c-03ac-4571-a0fe-9ff8756bfaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "name": "network-vif-plugged", "status": "completed", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:44.335694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:57:44.335694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:57:44.346136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1946a897-4ab6-4419-80ea-148a98fced5e req-ebb81c8c-03ac-4571-a0fe-9ff8756bfaf4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:44.346576 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-1946a897-4ab6-4419-80ea-148a98fced5e req-ebb81c8c-03ac-4571-a0fe-9ff8756bfaf4 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:44.360049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-1946a897-4ab6-4419-80ea-148a98fced5e req-ebb81c8c-03ac-4571-a0fe-9ff8756bfaf4 service nova] Creating event network-vif-plugged:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:57:44.364896 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-1946a897-4ab6-4419-80ea-148a98fced5e req-ebb81c8c-03ac-4571-a0fe-9ff8756bfaf4 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 Jan 24 16:57:44.365526 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 557/1133] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:45.187417 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:45.188018 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:45.194452 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:45.194929 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:45.195714 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:45.196150 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:45.327777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:45.335379 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:45.336867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:45.338012 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-694e3924-acfc-4577-bb17-2b0e6910e1b0 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1733 microversion: 2.20 time: 0.154305 Jan 24 16:57:45.339116 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 577/1134] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:45 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:46.359796 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:46.360532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:46.367703 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:46.368332 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:46.369138 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:46.369752 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:46.502411 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:46.510715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:46.512410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:57:46.513578 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-901d95a2-f0c0-4b6c-bec4-f7dd5f906042 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1720 microversion: 2.20 time: 0.158575 Jan 24 16:57:46.514160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 558/1135] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:57:46 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:57:49.014901 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:49.015847 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:49.022107 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:49.022566 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:49.023390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:49.023835 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:49.052135 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ef948738-bab3-48d3-beab-c8f885909de5 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041007 Jan 24 16:57:49.052675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 578/1136] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:57:49 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:49.062627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:49.063153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:49.069387 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:49.069844 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:49.070630 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:49.071104 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:49.099822 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-df7af9f3-9987-4f6b-8426-1f2f570d62cc tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8" status: 200 len: 194 microversion: 2.1 time: 0.040902 Jan 24 16:57:49.100398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 559/1137] 10.222.0.117 () {58 vars in 1417 bytes} [Mon Jan 24 16:57:49 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:50.393726 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f14f9766-0f66-4fa9-94b4-b997cdc2f959"}} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:57:50.394818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:50.401585 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:50.402034 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:50.402874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:50.403331 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:50.630410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7f0551a8-90f9-4ff3-9732-bd7e3d1b0379 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240234 Jan 24 16:57:50.632467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 579/1138] 10.222.0.117 () {60 vars in 1327 bytes} [Mon Jan 24 16:57:50 2022] POST /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:58.101788 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:58.102711 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:58.109740 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.110198 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.111028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.111498 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.142026 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-bf801cff-8928-4107-bdd7-577d7f79099e tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043945 Jan 24 16:57:58.142601 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 560/1139] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:57:58 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:58.391342 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:58.391876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:58.398017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.398466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.399285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.400351 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.428958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-4832e8ee-5a56-41bc-ab83-c34a5bcde700 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8" status: 200 len: 194 microversion: 2.1 time: 0.042430 Jan 24 16:57:58.429531 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 580/1140] 10.222.0.117 () {58 vars in 1417 bytes} [Mon Jan 24 16:57:58 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:57:58.439170 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:57:58.439689 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:57:58.445569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.446024 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.447334 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:57:58.447997 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:57:58.524337 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lazy-loading 'services' on Instance uuid d67bf828-807a-4965-8f63-5afb0e9a6750 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:57:58.592699 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4cbcbbe0-1b30-4a03-98c9-b0ffbba4cf41 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8" status: 202 len: 0 microversion: 2.1 time: 0.157163 Jan 24 16:57:58.593306 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 561/1141] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:57:58 2022] DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/9e17828a-4f77-407e-aa30-4d105eb2d0d8 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:58:00.747117 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:00.747627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:00.753818 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:00.754268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:00.755079 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:00.755519 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:00.783236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8b175d6b-4e15-421f-81bd-f7794d5baec1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/f14f9766-0f66-4fa9-94b4-b997cdc2f959" status: 200 len: 194 microversion: 2.1 time: 0.040467 Jan 24 16:58:00.783820 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 581/1142] 10.222.0.117 () {58 vars in 1417 bytes} [Mon Jan 24 16:58:00 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/f14f9766-0f66-4fa9-94b4-b997cdc2f959 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:58:00.795203 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:00.795783 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:00.802111 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:00.802568 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:00.803376 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:00.803816 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:00.880905 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lazy-loading 'services' on Instance uuid d67bf828-807a-4965-8f63-5afb0e9a6750 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:58:00.947694 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8d6fc55a-439b-4e3f-849c-af67aa6cc013 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/f14f9766-0f66-4fa9-94b4-b997cdc2f959" status: 202 len: 0 microversion: 2.1 time: 0.157872 Jan 24 16:58:00.948367 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 562/1143] 10.222.0.117 () {58 vars in 1420 bytes} [Mon Jan 24 16:58:00 2022] DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments/f14f9766-0f66-4fa9-94b4-b997cdc2f959 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:58:02.100770 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:02.101741 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:02.108707 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.109159 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.109940 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.110387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.140336 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ccb3bc9c-f5cf-42ad-ad72-029776b631b4 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043404 Jan 24 16:58:02.140928 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 582/1144] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:58:02 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:58:02.240527 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:02.241584 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:02.247674 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.248124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.248919 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.249359 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.278607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-afcb7a39-5083-4916-bf57-66733b1bf241 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042594 Jan 24 16:58:02.279226 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 563/1145] 10.222.0.117 () {58 vars in 1306 bytes} [Mon Jan 24 16:58:02 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 24 16:58:02.333872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:02.334358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:02.340441 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.340893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.341699 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.342138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.366561 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:58:02.440690 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-23ff7a59-ad71-46a2-b960-c67d58164c37 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 204 len: 0 microversion: 2.1 time: 0.110175 Jan 24 16:58:02.441346 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 583/1146] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:58:02 2022] DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:58:02.450100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:02.450710 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:02.456555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.457028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.457807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:02.458244 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:02.587895 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:02.595131 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6403d6c2-a5ae-4c0b-94ac-608f39da9b52 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1677 microversion: 2.1 time: 0.149336 Jan 24 16:58:02.595700 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 564/1147] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:02 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:03.613156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:03.613858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:03.621287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:03.621742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:03.622526 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:03.622996 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:03.753673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:03.761398 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-15ad2c44-d269-425f-9681-63f88090bbc1 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1677 microversion: 2.1 time: 0.152342 Jan 24 16:58:03.761969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 584/1148] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:03 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:04.777377 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:04.778114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:04.784637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:04.785127 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:04.785931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:04.786378 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:04.923736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:04.932042 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c6c452c4-61fa-4208-ba56-f20ff4fb10a2 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1677 microversion: 2.1 time: 0.158408 Jan 24 16:58:04.932716 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 565/1149] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:04 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:05.696032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-f2cb4bbe-f09e-4faa-aa65-571b9865d779 req-7a8e916e-4476-423a-8fb1-5d4351980e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67bf828-807a-4965-8f63-5afb0e9a6750", "name": "network-vif-deleted", "tag": "d8888aac-db3e-4a13-accf-8a758d4457a3"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:05.698605 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:58:05.698605 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:58:05.707563 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-f2cb4bbe-f09e-4faa-aa65-571b9865d779 req-7a8e916e-4476-423a-8fb1-5d4351980e90 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:05.708131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-f2cb4bbe-f09e-4faa-aa65-571b9865d779 req-7a8e916e-4476-423a-8fb1-5d4351980e90 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:05.722796 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-f2cb4bbe-f09e-4faa-aa65-571b9865d779 req-7a8e916e-4476-423a-8fb1-5d4351980e90 service nova] Creating event network-vif-deleted:d8888aac-db3e-4a13-accf-8a758d4457a3 for instance d67bf828-807a-4965-8f63-5afb0e9a6750 on hv-cinder-82611 Jan 24 16:58:05.729872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-f2cb4bbe-f09e-4faa-aa65-571b9865d779 req-7a8e916e-4476-423a-8fb1-5d4351980e90 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039279 Jan 24 16:58:05.731004 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 585/1150] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:58:05.949960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:05.950691 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:05.957002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:05.957529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:05.958312 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:05.958746 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:05.990416 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:05.990906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:05.991363 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lazy-loading 'fault' on Instance uuid d67bf828-807a-4965-8f63-5afb0e9a6750 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:58:06.031132 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb10d68444a4c6e947c1e356987736f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a57596de944ff6b3c322128a836000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:06.038402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2993362d-f1c5-42f1-81c3-fb60a2ebc942 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 200 len: 1331 microversion: 2.1 time: 0.092810 Jan 24 16:58:06.039010 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 566/1151] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:05 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:07.056889 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:07.057623 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:07.064178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:07.064635 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:07.065428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:07.065869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:07.079031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. Jan 24 16:58:07.079617 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:07.080440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e722ca1a-6197-4aef-96fb-6d12510c722d tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 404 len: 111 microversion: 2.1 time: 0.027832 Jan 24 16:58:07.080974 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 586/1152] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:07 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:58:07.089910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d9c5d0bd-2c98-4dcd-b545-5222f08074c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '.version_select at 0x7fba14de93a0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:07.108078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d9c5d0bd-2c98-4dcd-b545-5222f08074c8 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-911219173" status: 202 len: 0 microversion: 2.1 time: 0.022726 Jan 24 16:58:07.108623 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 567/1153] 10.222.0.117 () {58 vars in 1222 bytes} [Mon Jan 24 16:58:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-911219173 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:58:09.961043 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:09.962599 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:09.968982 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:09.969431 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:09.970207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:09.970642 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:09.984738 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. Jan 24 16:58:09.985334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:09.986144 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-d3e498cc-d7d9-4e8d-bad9-3f3e1e08cf51 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 404 len: 111 microversion: 2.1 time: 0.028841 Jan 24 16:58:09.986673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 587/1154] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:58:09 2022] DELETE /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:58:09.994935 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:09.995545 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: d67bf828-807a-4965-8f63-5afb0e9a6750] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:10.001317 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:10.001762 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:10.002563 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:10.003022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:10.016682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. Jan 24 16:58:10.017256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance d67bf828-807a-4965-8f63-5afb0e9a6750 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:10.018086 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-9c449696-bc96-42b4-a975-014002b9b5b6 tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750" status: 404 len: 111 microversion: 2.1 time: 0.027367 Jan 24 16:58:10.018603 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 568/1155] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:09 2022] GET /compute/v2.1/servers/d67bf828-807a-4965-8f63-5afb0e9a6750 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:58:11.143123 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:11.143652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:11.150675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:11.151207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:11.153048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:11.153048 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:11.166875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. Jan 24 16:58:11.168271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:11.168418 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-301a8ad0-e130-44fd-9be2-3342b360416a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 404 len: 111 microversion: 2.1 time: 0.029099 Jan 24 16:58:11.168942 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 588/1156] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:58:11 2022] DELETE /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:58:11.177652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:11.178262 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] [instance: 10c5d45c-1da7-4563-ac75-ae5d1dc892ec] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:11.184889 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:11.185342 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:11.186136 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:11.186573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:11.203150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] HTTP exception thrown: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. Jan 24 16:58:11.203761 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] Returning 404 to user: Instance 10c5d45c-1da7-4563-ac75-ae5d1dc892ec could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:11.204599 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-864ff933-27f1-4fcd-bdde-c19c18e0bf8a tempest-AttachVolumeTestJSON-894892376 tempest-AttachVolumeTestJSON-894892376-project] 10.222.0.117 "GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec" status: 404 len: 111 microversion: 2.1 time: 0.030869 Jan 24 16:58:11.205162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 569/1157] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:11 2022] GET /compute/v2.1/servers/10c5d45c-1da7-4563-ac75-ae5d1dc892ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 16:58:22.181843 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:22.182786 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:22.189358 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.189816 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.190608 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.191080 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.221131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-22d2218d-9aff-471d-bbe0-e3bb4c50e375 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043504 Jan 24 16:58:22.221687 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 589/1158] 10.222.0.117 () {60 vars in 1347 bytes} [Mon Jan 24 16:58:22 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:22.279575 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:22.280090 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:22.286339 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.286827 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.287612 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.288049 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.312514 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:58:22.386205 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-dc547222-b4ae-479c-89f0-6e2b6d3ad76c tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 204 len: 0 microversion: 2.20 time: 0.110070 Jan 24 16:58:22.390722 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 570/1159] 10.222.0.117 () {60 vars in 1284 bytes} [Mon Jan 24 16:58:22 2022] DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:58:22.395460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:22.396060 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:22.403170 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.403614 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.404384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:22.404819 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:22.536658 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:22.544735 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:22.546491 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:22.547673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ee6899eb-11eb-492a-a870-cf2bcba45e3f tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.155900 Jan 24 16:58:22.548232 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 590/1160] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:22 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:58:23.566035 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:23.566735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:23.573396 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:23.573837 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:23.574627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:23.575084 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:23.713706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:23.721593 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:23.723125 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:23.724289 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-296e9208-fa49-4e37-9d5a-a6e4907fcaf4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1726 microversion: 2.20 time: 0.162403 Jan 24 16:58:23.724851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 571/1161] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:23 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:58:24.743457 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:24.744001 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:24.750325 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:24.750789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:24.751571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:24.752003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:24.775146 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-d8dea69f-85da-4fb8-b12e-cd35a9d68ab6 req-1abefc50-043e-4c30-ba9c-2296342e0ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f078fbc1-030c-4caf-9999-d2810f26d0bc", "name": "network-vif-deleted", "tag": "fd9d7942-a8b2-4999-a7ae-e2a43c49a79d"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:24.776449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:58:24.776449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:58:24.785018 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d8dea69f-85da-4fb8-b12e-cd35a9d68ab6 req-1abefc50-043e-4c30-ba9c-2296342e0ec5 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:24.785488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-d8dea69f-85da-4fb8-b12e-cd35a9d68ab6 req-1abefc50-043e-4c30-ba9c-2296342e0ec5 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:24.798080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-d8dea69f-85da-4fb8-b12e-cd35a9d68ab6 req-1abefc50-043e-4c30-ba9c-2296342e0ec5 service nova] Creating event network-vif-deleted:fd9d7942-a8b2-4999-a7ae-e2a43c49a79d for instance f078fbc1-030c-4caf-9999-d2810f26d0bc on hv-cinder-82611 Jan 24 16:58:24.803443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-d8dea69f-85da-4fb8-b12e-cd35a9d68ab6 req-1abefc50-043e-4c30-ba9c-2296342e0ec5 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033823 Jan 24 16:58:24.806895 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 572/1162] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:58:24.834542 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:24.843686 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:24.845349 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '50e012c5fcde4462984a57878629fd6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca1c94bee974fb986196c0be4064812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:24.846720 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-dde819a2-540e-4768-9d87-94915c873471 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 200 len: 1658 microversion: 2.20 time: 0.107127 Jan 24 16:58:24.847303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 591/1163] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:24 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 1658 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 24 16:58:25.865441 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:25.866148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:25.872823 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:25.873276 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:25.874066 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:25.874507 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:25.888499 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. Jan 24 16:58:25.889102 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:25.889930 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-6ac3fab9-2009-49d5-9e71-a23a6b7530e4 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 404 len: 111 microversion: 2.20 time: 0.029182 Jan 24 16:58:25.890478 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 573/1164] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:25 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:58:25.899533 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f510d4d4-e858-48eb-9fed-215763b02543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '.version_select at 0x7fba15122d30>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:25.918633 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f510d4d4-e858-48eb-9fed-215763b02543 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467692217" status: 204 len: 0 microversion: 2.20 time: 0.023546 Jan 24 16:58:25.919257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 592/1165] 10.222.0.117 () {60 vars in 1263 bytes} [Mon Jan 24 16:58:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467692217 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 24 16:58:27.709543 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:27.710465 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:27.716844 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:27.717293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:27.718073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:27.718509 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:27.732555 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. Jan 24 16:58:27.733190 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:27.734021 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-ef6181a6-c1b6-48aa-88c5-99acda64fa4b tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 404 len: 111 microversion: 2.20 time: 0.028215 Jan 24 16:58:27.734569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 574/1166] 10.222.0.117 () {60 vars in 1284 bytes} [Mon Jan 24 16:58:27 2022] DELETE /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:58:27.742975 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:27.743591 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: f078fbc1-030c-4caf-9999-d2810f26d0bc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:27.750675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:27.751163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:27.751957 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:27.752399 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:27.766051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. Jan 24 16:58:27.766652 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance f078fbc1-030c-4caf-9999-d2810f26d0bc could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:27.767631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-26810936-fc38-4907-bbba-cf90da85e4a8 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc" status: 404 len: 111 microversion: 2.20 time: 0.028980 Jan 24 16:58:27.768198 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 593/1167] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:27 2022] GET /compute/v2.1/servers/f078fbc1-030c-4caf-9999-d2810f26d0bc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:58:28.901034 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:28.901564 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:28.907812 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:28.908260 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:28.909160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:28.909486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:28.924028 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. Jan 24 16:58:28.924626 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:28.925442 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-1b133849-5b95-41d7-9894-264a74e681f9 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 404 len: 111 microversion: 2.20 time: 0.028658 Jan 24 16:58:28.926173 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 575/1168] 10.222.0.117 () {60 vars in 1284 bytes} [Mon Jan 24 16:58:28 2022] DELETE /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:58:28.934225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:28.935081 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] [instance: fb3e6d05-f352-44f0-88b9-77cf52d979a3] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:28.941935 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:28.942386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:28.943208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:28.943650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:28.957896 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] HTTP exception thrown: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. Jan 24 16:58:28.958414 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] Returning 404 to user: Instance fb3e6d05-f352-44f0-88b9-77cf52d979a3 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:28.959271 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-2163ede5-8fa0-4d78-a123-7c1de54f24a1 tempest-AttachVolumeShelveTestJSON-1574075402 tempest-AttachVolumeShelveTestJSON-1574075402-project] 10.222.0.117 "GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3" status: 404 len: 111 microversion: 2.20 time: 0.028921 Jan 24 16:58:28.959810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 594/1169] 10.222.0.117 () {60 vars in 1281 bytes} [Mon Jan 24 16:58:28 2022] GET /compute/v2.1/servers/fb3e6d05-f352-44f0-88b9-77cf52d979a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 24 16:58:35.443588 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:35.444366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:35.451245 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:35.451735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:35.452848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:35.453294 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:35.479316 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lazy-loading 'flavor' on Instance uuid a016ddd5-58a8-4b20-b190-93d35048debc {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:58:35.554908 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8a74b2ec-d1f9-475f-907f-45b1a7ba66f3 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "POST /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc/action" status: 202 len: 0 microversion: 2.1 time: 0.114797 Jan 24 16:58:35.555772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 576/1170] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:58:35 2022] POST /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:58:35.565460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:35.567230 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:35.575683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:35.576174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:35.577072 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:35.577510 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:35.766795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:35.775943 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-15c31e8a-cd8b-4f13-aedb-4d483d5f7dbb tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.215202 Jan 24 16:58:35.777020 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 595/1171] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:35 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:36.795093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:36.795847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:36.801867 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:36.802354 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:36.803819 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:36.804364 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:36.939789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:36.947420 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-8d4819a5-9ec4-494f-9120-ea748ce2e1ca tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.157142 Jan 24 16:58:36.950875 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 577/1172] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:36 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:37.249435 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:37.250011 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:37.256933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.257595 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:37.258601 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.259066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:37.285788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Going to try to terminate instance {{(pid=127827) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 16:58:37.362122 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-841663f9-514f-4f9c-aa22-35a9d690fdef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "DELETE /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 204 len: 0 microversion: 2.1 time: 0.116056 Jan 24 16:58:37.362811 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 596/1173] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 16:58:37 2022] DELETE /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 16:58:37.372093 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:37.372872 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:37.378924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.379366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:37.380153 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.380589 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:37.521936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:37.530268 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a53a93e6-7e94-4a1c-808f-7ee49d85e6f2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.161903 Jan 24 16:58:37.530917 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 578/1174] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:37 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:37.965880 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:37.966588 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:37.972516 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.972965 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:37.973745 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:37.974203 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:38.105976 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:38.113294 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cd805db1-cb50-4a80-b1ed-4f203bec612e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.151554 Jan 24 16:58:38.113869 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 597/1175] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:37 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:38.548687 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:38.549383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:38.556490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:38.556943 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:38.557729 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:38.558169 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:38.692818 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:38.701318 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-93733522-d001-4e72-a9fe-4b44699f2fcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.156466 Jan 24 16:58:38.701902 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 579/1176] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:38 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:39.131858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:39.132469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:39.139031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:39.139475 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:39.140286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:39.140723 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:39.274888 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:39.282450 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-36337beb-18ec-4017-ba94-2bd799dcfb52 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.154331 Jan 24 16:58:39.283050 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 598/1177] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:39 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:39.718813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:39.719472 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:39.725931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:39.726375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:39.727177 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:39.727611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:39.860723 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:39.869162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-db8cd994-4a07-43fb-aeea-888b1eb565fd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.153866 Jan 24 16:58:39.869587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 580/1178] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:39 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:40.300252 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:40.300860 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:40.307950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:40.308394 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:40.309162 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:40.309592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:40.439683 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:40.447156 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6c59978b-6301-4a1c-a36e-589b2cd86c79 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.150539 Jan 24 16:58:40.447734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 599/1179] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:40 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:40.886607 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:40.888053 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:40.895921 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:40.896382 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:40.897920 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:40.898372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:41.046848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:41.055652 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fbbce91c-e514-4a3b-b012-c7e9363a414d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.172891 Jan 24 16:58:41.056231 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 581/1180] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:40 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:41.464645 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:41.465195 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:41.471462 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:41.471909 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:41.472674 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:41.473106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:41.607449 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:41.614631 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-f1bbd770-8834-4548-892c-416b5d37e4f1 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.153725 Jan 24 16:58:41.615285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 600/1181] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:41 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:42.072915 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:42.073551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:42.080817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:42.081267 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:42.082043 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:42.082475 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:42.215975 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:42.223349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-606ae6a1-2ac2-457c-849e-294eec4b41a1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.154855 Jan 24 16:58:42.223907 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 582/1182] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:42 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:42.631332 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:42.631956 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:42.638222 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:42.638673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:42.639488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:42.639932 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:42.770138 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:42.777713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-424a2c16-5f2e-46ad-bfa5-10d0c57fc885 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.150141 Jan 24 16:58:42.778285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 601/1183] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:42 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:43.239993 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:43.240595 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:43.247022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:43.247479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:43.248266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:43.248706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:43.383894 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:43.391242 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-74a995c5-f1b5-4f79-a653-c815dd0472b5 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.155051 Jan 24 16:58:43.391810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 583/1184] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:43 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:43.795592 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:43.796207 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:43.803197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:43.803730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:43.804575 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:43.805017 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:43.935734 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:43.943009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6b860ad3-3cb0-48b2-bc6a-7fafb20a2873 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.151395 Jan 24 16:58:43.944886 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 602/1185] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:43 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:44.409402 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:44.410006 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:44.417260 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:44.417749 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:44.418688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:44.419148 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:44.560753 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:44.569149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-252b217f-def6-415f-bb4f-e7f6adcfd8d1 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1580 microversion: 2.1 time: 0.162943 Jan 24 16:58:44.569736 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 584/1186] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:44 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:44.782828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-a4571555-c1bb-4672-a5ec-9a14d66c167d req-bfc045a4-5ac3-481b-9832-6b5da62f3e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921adf61-2d82-49af-8dd2-dd2fbbd585b4", "name": "network-vif-deleted", "tag": "41d7d71d-3e7f-44e5-9394-f4d62e1f557f"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:44.784800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:58:44.784800 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:58:44.791941 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-a4571555-c1bb-4672-a5ec-9a14d66c167d req-bfc045a4-5ac3-481b-9832-6b5da62f3e3b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:44.792393 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-a4571555-c1bb-4672-a5ec-9a14d66c167d req-bfc045a4-5ac3-481b-9832-6b5da62f3e3b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:44.804410 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-a4571555-c1bb-4672-a5ec-9a14d66c167d req-bfc045a4-5ac3-481b-9832-6b5da62f3e3b service nova] Creating event network-vif-deleted:41d7d71d-3e7f-44e5-9394-f4d62e1f557f for instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 on hv-cinder-82611 Jan 24 16:58:44.809431 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-a4571555-c1bb-4672-a5ec-9a14d66c167d req-bfc045a4-5ac3-481b-9832-6b5da62f3e3b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030604 Jan 24 16:58:44.810027 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 603/1187] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:58:44.962320 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:44.963333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:44.969460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:44.969914 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:44.970705 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:44.971182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:45.131248 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:45.145302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-99f43b55-7feb-4b68-bdfc-95e179a095ab tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.187600 Jan 24 16:58:45.146998 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 585/1188] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:44 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:45.586273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:45.587009 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:45.593582 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:45.594033 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:45.594859 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:45.595307 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:45.660851 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:45.668469 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-56aa816c-296d-4111-872c-e3afdeec95d3 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1229 microversion: 2.1 time: 0.086800 Jan 24 16:58:45.669380 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 604/1189] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:45 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:46.163642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:46.164255 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:46.171331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:46.171720 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:46.172490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:46.172925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:46.310048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:46.317394 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2e756d52-b45f-404d-b819-319d8cd1d89a tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.157715 Jan 24 16:58:46.318124 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 586/1190] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:46 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:46.685341 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:46.685951 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:46.692204 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:46.692649 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:46.693432 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:46.693867 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:46.754066 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:46.762644 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-83a95b36-db43-4b24-986e-b30955d4a55a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1229 microversion: 2.1 time: 0.080818 Jan 24 16:58:46.763427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 605/1191] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:46 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1229 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:47.336852 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:47.339064 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:47.347477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:47.348528 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:47.349865 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:47.350547 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:47.507508 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:47.517100 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cd08cad0-7a6e-4ff5-bb84-9f9504ad1330 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.186312 Jan 24 16:58:47.517762 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 587/1192] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:47 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:47.780604 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:47.781178 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:47.798424 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:47.798902 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:47.799709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:47.800147 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:47.837096 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:47.837629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:47.838255 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lazy-loading 'fault' on Instance uuid 921adf61-2d82-49af-8dd2-dd2fbbd585b4 {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 16:58:47.886663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:47.895268 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-173022d2-905d-4604-b351-5764bb3264c6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 200 len: 1234 microversion: 2.1 time: 0.118300 Jan 24 16:58:47.896231 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 606/1193] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:47 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 1234 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:48.535185 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:48.535800 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:48.542713 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:48.543190 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:48.543963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:48.544648 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:48.679423 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:48.686702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b10f1460-e7e2-4c3d-932e-b20454e9c6d5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.155247 Jan 24 16:58:48.687298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 588/1194] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:48 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:48.914040 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:48.914939 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:48.921599 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:48.922110 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:48.922945 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:48.923386 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:48.937720 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] HTTP exception thrown: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. Jan 24 16:58:48.938318 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Returning 404 to user: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 16:58:48.939470 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-481e5697-3a8d-4c35-80e5-7331d3325a7d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 404 len: 111 microversion: 2.1 time: 0.030077 Jan 24 16:58:48.940673 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 607/1195] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:48 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 16:58:49.097666 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1786844453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1092702864", "security_groups": [{"name": "tempest-secgroup-smoke-245594148"}], "block_device_mapping_v2": [{"uuid": "2574e922-4813-4838-9240-99c9966aa4b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65b89cb5-235f-4d33-82a0-9e74a9bccb1e"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:49.221980 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] validate_networks() for [('65b89cb5-235f-4d33-82a0-9e74a9bccb1e', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 16:58:49.590005 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 16:58:49.590605 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 16:58:49.590944 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 16:58:49.591395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 16:58:49.591810 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 16:58:49.601277 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:49.601733 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:49.602558 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:49.603033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:49.619398 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 16:58:49.623374 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for user 40a416737b484014bb7cf011bab63b63 and project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 16:58:49.677934 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 16:58:49.680162 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2574e922-4813-4838-9240-99c9966aa4b5',volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 16:58:49.703946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:49.704557 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:49.710518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:49.711008 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:49.711795 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:49.712239 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:49.804696 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5f9e265e-5df6-4f96-8f26-f1a07dd4c310 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.711499 Jan 24 16:58:49.805532 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 589/1196] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 16:58:49 2022] POST /compute/v2.1/servers => generated 407 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 16:58:49.816114 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0564678c-601d-477d-8539-cdc7b6bf4492 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:49.817381 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0564678c-601d-477d-8539-cdc7b6bf4492 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:49.854131 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:49.861719 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3c8e0389-5ce7-458f-9948-b4de5254bcdf tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.161331 Jan 24 16:58:49.862798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 608/1197] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:49 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:49.876180 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0564678c-601d-477d-8539-cdc7b6bf4492 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:49.883645 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0564678c-601d-477d-8539-cdc7b6bf4492 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1098 microversion: 2.1 time: 0.072236 Jan 24 16:58:49.884392 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 590/1198] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:49 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1098 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:50.886142 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:50.888769 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:50.902054 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:50.903193 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:50.914487 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:50.914886 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:50.916284 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:50.916874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:50.920201 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:50.920684 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:50.925286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:50.925962 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:51.000480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:51.011453 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-df45a5ab-3234-4b35-a002-5d5a9954e36c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1214 microversion: 2.1 time: 0.112879 Jan 24 16:58:51.012781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 591/1199] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:50 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:51.183788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:51.193302 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6d1c9dfc-61ce-4bdf-9194-8a48fb04a32d tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.314638 Jan 24 16:58:51.194390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 609/1200] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:50 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:52.029606 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:52.030238 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:52.038657 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:52.039154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:52.039962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:52.040406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:52.209965 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:52.211892 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:52.212571 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:52.217336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-915f6130-5dbf-47cf-b42d-f2781f9afec8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.191743 Jan 24 16:58:52.218457 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 592/1201] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:52 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:52.219250 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:52.219897 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:52.220737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:52.221155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:52.459815 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:52.472984 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3b5d4b50-22fd-4491-b16a-94676d4cdcef tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.265253 Jan 24 16:58:52.475323 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 610/1202] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:52 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:52.737434 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-9e563fbe-590c-47db-936a-f0986259adac req-c0b89bdf-e878-4875-b706-7359b120c221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a62339-b2a1-409a-9c18-64ec7f8263f7", "tag": "e43a4ce0-246d-42b6-873c-91ce5321e7de"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:52.740962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:58:52.740962 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:58:52.753436 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9e563fbe-590c-47db-936a-f0986259adac req-c0b89bdf-e878-4875-b706-7359b120c221 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:52.754106 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-9e563fbe-590c-47db-936a-f0986259adac req-c0b89bdf-e878-4875-b706-7359b120c221 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:52.780405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-9e563fbe-590c-47db-936a-f0986259adac req-c0b89bdf-e878-4875-b706-7359b120c221 service nova] Creating event network-changed:e43a4ce0-246d-42b6-873c-91ce5321e7de for instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 on hv-cinder-82611 Jan 24 16:58:52.785940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-9e563fbe-590c-47db-936a-f0986259adac req-c0b89bdf-e878-4875-b706-7359b120c221 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053473 Jan 24 16:58:52.787078 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 593/1203] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:58:53.234391 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:53.235027 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:53.242430 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:53.242913 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:53.243708 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:53.244149 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:53.383966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:53.391848 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3df64595-87f1-4740-b3f1-22e286a61425 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.161016 Jan 24 16:58:53.392756 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 611/1204] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:53 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:53.493638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:53.494349 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:53.500748 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:53.501207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:53.501984 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:53.502425 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:53.642781 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:53.650927 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-416c5c0c-9979-4bb1-9187-07acff004d88 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.162360 Jan 24 16:58:53.651567 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 594/1205] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:53 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:54.408279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:54.408823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:54.415743 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:54.416193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:54.416991 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:54.417427 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:54.581742 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:54.590364 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-84714b3e-d67c-43be-a432-18886f026032 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.185750 Jan 24 16:58:54.591256 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 612/1206] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:54 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:54.668541 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:54.670351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:54.678046 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:54.679490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:54.680216 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:54.681142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:54.906324 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:54.915525 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c1f99c70-5e57-41e8-8677-dd3635123788 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.250867 Jan 24 16:58:54.930181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 595/1207] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:54 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:55.607681 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:55.608303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:55.614720 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:55.615334 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:55.616134 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:55.616580 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:55.756044 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:55.763304 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3853287b-e070-4447-a35e-f204bcdfb7f9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.159471 Jan 24 16:58:55.763874 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 613/1208] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:55 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:55.934826 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:55.935667 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:55.944817 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:55.945551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:55.952676 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:55.953163 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:56.087772 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:56.094982 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f7c221aa-f0d3-4a93-b43c-f7b64f987050 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.164940 Jan 24 16:58:56.095550 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 596/1209] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:55 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:56.780777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:56.781553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:56.793894 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:56.794527 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:56.795588 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:56.796032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:56.951312 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:56.959780 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1e64ce84-841b-4bc8-b169-287f803a914c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.182963 Jan 24 16:58:56.960809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 614/1210] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:56 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:57.112641 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:57.113415 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:57.120708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.121158 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.121936 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.122366 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.260351 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:57.268287 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-99cd66ca-bdc3-478b-b1a9-b48d88614a60 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1571 microversion: 2.1 time: 0.159613 Jan 24 16:58:57.268946 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 597/1211] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:57 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:57.287899 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:57.288506 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:57.294992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.295151 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.296554 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.297002 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.396546 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8feea030-b796-4d58-99e7-b8bb93f68e58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "POST /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc/action" status: 202 len: 0 microversion: 2.1 time: 0.112488 Jan 24 16:58:57.397158 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 615/1212] 10.222.0.117 () {60 vars in 1282 bytes} [Mon Jan 24 16:58:57 2022] POST /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 16:58:57.404986 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:57.405661 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:57.411848 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.412195 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.413176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.413616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.578531 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:57.586278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c6750f11-5015-42dc-a7a5-8f6304e59d41 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1519 microversion: 2.1 time: 0.184954 Jan 24 16:58:57.586881 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 598/1213] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:57 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:58:57.978789 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:57.980193 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:57.992180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.993287 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:57.994445 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:57.995118 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:58.159736 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:58.169978 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-43338a1a-58da-4927-ba0d-68ee779121b8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.197495 Jan 24 16:58:58.170713 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 616/1214] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:57 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:58.602969 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:58.603573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:58.610094 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:58.610677 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:58.611649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:58.612189 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:58.784585 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:58.792862 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-a9f889d9-e43d-4cc8-962c-ff600d051148 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.194140 Jan 24 16:58:58.793851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 599/1215] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:58 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:59.188098 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:59.188832 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:59.196568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:59.197309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:59.198309 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:59.198744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:59.517190 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:58:59.542295 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3ab9f0f0-d625-47ed-9bcc-f6d5867465b0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.358955 Jan 24 16:58:59.545279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 617/1216] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:59 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:58:59.811745 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:58:59.814515 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:58:59.820801 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:59.821256 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:59.822069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:58:59.822490 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:58:59.989893 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-99f5106c-0566-4bc7-82fd-37c4d221bb2e req-40c86a45-fb6d-4183-88bc-273be096f098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "name": "network-vif-unplugged", "status": "completed", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:58:59.991910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:58:59.991910 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:58:59.992827 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:00.006249 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-99f5106c-0566-4bc7-82fd-37c4d221bb2e req-40c86a45-fb6d-4183-88bc-273be096f098 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:00.009003 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5dacbb28-af6a-4e5a-8ef5-056d263382a0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.200788 Jan 24 16:59:00.011702 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 600/1217] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:58:59 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:00.014354 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-99f5106c-0566-4bc7-82fd-37c4d221bb2e req-40c86a45-fb6d-4183-88bc-273be096f098 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:00.037290 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-99f5106c-0566-4bc7-82fd-37c4d221bb2e req-40c86a45-fb6d-4183-88bc-273be096f098 service nova] Creating event network-vif-unplugged:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 16:59:00.045003 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-99f5106c-0566-4bc7-82fd-37c4d221bb2e req-40c86a45-fb6d-4183-88bc-273be096f098 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059293 Jan 24 16:59:00.046479 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 618/1218] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 16:59:00.558983 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:00.559692 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:00.565406 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:00.565859 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:00.566642 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:00.567572 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:00.714466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:00.721831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-5bd3176d-8c1b-4581-9717-e0484e0270a6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.166478 Jan 24 16:59:00.722424 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 601/1219] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:00 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:01.027966 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:01.032055 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:01.034614 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:01.035097 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:01.036737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:01.037225 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:01.193833 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:01.202086 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-5e25fab5-bf41-48ce-8235-ef45a4b7a942 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.178519 Jan 24 16:59:01.202872 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 619/1220] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:01 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:01.739740 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:01.740373 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:01.746797 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:01.747360 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:01.748217 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:01.748731 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:01.962234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:01.969673 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fea25f1c-f77d-408b-b7ae-70cecf2cd026 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.234067 Jan 24 16:59:01.970182 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 602/1221] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:01 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:02.220196 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:02.220777 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:02.228992 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:02.229439 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:02.230233 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:02.230666 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:02.376512 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:02.384521 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-13da9685-ad08-40fe-ba95-ae88bab889d7 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.168391 Jan 24 16:59:02.385247 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 620/1222] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:02 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:02.986237 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:02.986968 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:02.994336 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:02.994876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:02.995735 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:02.996234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:03.140000 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:03.148207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f5225f2c-e4ac-4436-ab38-430d1148c3cf tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.165530 Jan 24 16:59:03.148782 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 603/1223] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:02 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:03.402130 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:03.402771 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:03.409103 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:03.409555 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:03.410503 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:03.411057 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:03.554488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:03.561875 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-62c8c854-2276-46e3-9653-410b566c786e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.163738 Jan 24 16:59:03.562675 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 621/1224] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:03 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 16:59:04.166160 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:04.167331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:04.173583 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:04.174215 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:04.175022 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:04.175454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:04.311183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:04.318931 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c646f6da-64e0-4108-a2d2-80e1418db446 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.157370 Jan 24 16:59:04.319751 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 604/1225] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:04 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:04.581141 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:04.581767 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:04.590064 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:04.590606 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:04.591543 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:04.591988 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:04.737751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:04.749729 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-8bb23973-f8e4-4bc5-895f-5714bf6f4726 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.172684 Jan 24 16:59:04.750308 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 622/1226] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:04 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:05.336418 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:05.337033 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:05.343380 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:05.343834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:05.344613 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:05.345051 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:05.482519 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:05.491833 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fd090fc3-d580-4221-a44e-325aea909441 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.159809 Jan 24 16:59:05.492412 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 605/1227] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:05 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:05.767505 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:05.768286 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:05.775858 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:05.776306 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:05.777102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:05.777536 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:05.918829 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:05.926998 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-3a6f854f-cab8-4c06-9412-118475e6ab26 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.163843 Jan 24 16:59:05.927663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 623/1228] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:05 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:06.078604 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-01f10f37-1676-4c46-8f91-2fc3077378b3 req-b734be97-9027-4623-932b-0d8d8875cf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a62339-b2a1-409a-9c18-64ec7f8263f7", "name": "network-vif-plugged", "status": "completed", "tag": "e43a4ce0-246d-42b6-873c-91ce5321e7de"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:59:06.080175 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:59:06.080175 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:59:06.088570 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-01f10f37-1676-4c46-8f91-2fc3077378b3 req-b734be97-9027-4623-932b-0d8d8875cf7d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:06.089015 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-01f10f37-1676-4c46-8f91-2fc3077378b3 req-b734be97-9027-4623-932b-0d8d8875cf7d service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:06.100829 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-01f10f37-1676-4c46-8f91-2fc3077378b3 req-b734be97-9027-4623-932b-0d8d8875cf7d service nova] Creating event network-vif-plugged:e43a4ce0-246d-42b6-873c-91ce5321e7de for instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 on hv-cinder-82611 Jan 24 16:59:06.106383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-01f10f37-1676-4c46-8f91-2fc3077378b3 req-b734be97-9027-4623-932b-0d8d8875cf7d service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 Jan 24 16:59:06.107466 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 606/1229] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:59:06.510629 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:06.511265 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:06.517718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:06.518175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:06.519064 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:06.520275 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:06.659624 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:06.667775 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-9a94ace2-2927-4317-b705-d1ddf8cb62ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1269 microversion: 2.1 time: 0.160774 Jan 24 16:59:06.668621 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 624/1230] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:06 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:06.945206 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:06.945813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:06.952142 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:06.952598 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:06.953383 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:06.953825 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:07.091273 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:07.100270 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-06ccb764-e96b-46ef-85a3-7f38c0b96c58 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1577 microversion: 2.1 time: 0.159636 Jan 24 16:59:07.100844 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 607/1231] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:06 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:07.685656 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:07.687163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:07.694717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:07.695234 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:07.696242 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:07.696868 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:07.834335 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:07.841725 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7c26eb32-7ad5-4d3e-b2c6-cda2d3f25dcd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1456 microversion: 2.1 time: 0.160000 Jan 24 16:59:07.842291 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 625/1232] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:07 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1456 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:07.857395 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:07.858250 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:07.865448 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:07.865831 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:07.866624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:07.867095 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:08.020840 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:08.028624 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cce622e3-901b-4485-9b6c-cf0df5ee92b9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1456 microversion: 2.1 time: 0.174814 Jan 24 16:59:08.029208 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 608/1233] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:07 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1456 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:08.123082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 16:59:08.124050 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 16:59:08.131756 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:08.132655 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:08.133839 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:08.134538 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:08.327828 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 16:59:08.336717 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-71267e7c-c6ea-4278-a544-a3b74f419f68 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1564 microversion: 2.1 time: 0.221737 Jan 24 16:59:08.337610 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 626/1234] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 16:59:08 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 16:59:10.088789 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-0edf9e15-bbed-4cde-8d2a-fa8064204189 req-5b54c630-5b7a-487d-8909-27363aa91e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a62339-b2a1-409a-9c18-64ec7f8263f7", "tag": "e43a4ce0-246d-42b6-873c-91ce5321e7de"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:59:10.090444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:59:10.090444 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 16:59:10.098851 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0edf9e15-bbed-4cde-8d2a-fa8064204189 req-5b54c630-5b7a-487d-8909-27363aa91e2b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:10.099421 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0edf9e15-bbed-4cde-8d2a-fa8064204189 req-5b54c630-5b7a-487d-8909-27363aa91e2b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:10.125104 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-0edf9e15-bbed-4cde-8d2a-fa8064204189 req-5b54c630-5b7a-487d-8909-27363aa91e2b service nova] Creating event network-changed:e43a4ce0-246d-42b6-873c-91ce5321e7de for instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 on hv-cinder-82611 Jan 24 16:59:10.131405 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-0edf9e15-bbed-4cde-8d2a-fa8064204189 req-5b54c630-5b7a-487d-8909-27363aa91e2b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046338 Jan 24 16:59:10.132638 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 609/1235] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 16:59:10.208677 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-d5aebe5b-9065-4f75-98fa-86cc87d8e681 req-5a0dffa8-9272-45e4-8449-c470b98eac56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "name": "network-vif-plugged", "status": "completed", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 16:59:10.210454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 16:59:10.210454 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 16:59:10.218999 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d5aebe5b-9065-4f75-98fa-86cc87d8e681 req-5a0dffa8-9272-45e4-8449-c470b98eac56 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 16:59:10.219594 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-d5aebe5b-9065-4f75-98fa-86cc87d8e681 req-5a0dffa8-9272-45e4-8449-c470b98eac56 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 16:59:10.232959 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-d5aebe5b-9065-4f75-98fa-86cc87d8e681 req-5a0dffa8-9272-45e4-8449-c470b98eac56 service nova] Creating event network-vif-plugged:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 16:59:10.238958 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-d5aebe5b-9065-4f75-98fa-86cc87d8e681 req-5a0dffa8-9272-45e4-8449-c470b98eac56 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034834 Jan 24 16:59:10.239808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 627/1236] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 16:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:00:47.833715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:47.834522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:00:47.841173 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:47.841556 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:47.842355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:47.842815 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:47.868941 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 17:00:47.953682 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-862555a1-e661-477b-ad19-cb095bc21539 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "DELETE /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 204 len: 0 microversion: 2.1 time: 0.125887 Jan 24 17:00:47.954569 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 610/1237] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 17:00:47 2022] DELETE /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 17:00:47.964239 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:47.964945 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:00:47.967534 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-34683de8-7e33-4861-9c20-27a885f8289c req-419eb24c-64c3-4a97-8b12-3523e20b25cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:00:47.969101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:00:47.969101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:00:47.971325 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:47.971759 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:47.973309 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:47.973741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:47.977212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-34683de8-7e33-4861-9c20-27a885f8289c req-419eb24c-64c3-4a97-8b12-3523e20b25cb service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:47.977668 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-34683de8-7e33-4861-9c20-27a885f8289c req-419eb24c-64c3-4a97-8b12-3523e20b25cb service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:47.989209 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-34683de8-7e33-4861-9c20-27a885f8289c req-419eb24c-64c3-4a97-8b12-3523e20b25cb service nova] Creating event network-changed:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 17:00:47.994437 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-34683de8-7e33-4861-9c20-27a885f8289c req-419eb24c-64c3-4a97-8b12-3523e20b25cb service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164597 Jan 24 17:00:47.995492 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 628/1238] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:00:48.181832 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:00:48.189927 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c27a9566-57c9-49b6-9b6c-fc3d1615dc9e tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1570 microversion: 2.1 time: 0.229584 Jan 24 17:00:48.191616 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 611/1239] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:00:47 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1570 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:00:49.209236 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:49.209936 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:00:49.216467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:49.216922 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:49.217751 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:49.218189 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:49.399365 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:00:49.406627 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-03f76c78-3efe-4785-ba7c-7ca655119be8 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1451 microversion: 2.1 time: 0.201442 Jan 24 17:00:49.407174 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 629/1240] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:00:49 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1451 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:00:50.059080 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-ba561b3d-ad49-406a-98e7-b8c49721145d req-d9075590-ac7f-445f-909c-cc6508cd80c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a016ddd5-58a8-4b20-b190-93d35048debc", "name": "network-vif-deleted", "tag": "020ec9b3-10b6-48ee-9f35-59587ddb3bf5"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:00:50.061708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:00:50.061708 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 17:00:50.071809 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ba561b3d-ad49-406a-98e7-b8c49721145d req-d9075590-ac7f-445f-909c-cc6508cd80c1 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:50.072269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-ba561b3d-ad49-406a-98e7-b8c49721145d req-d9075590-ac7f-445f-909c-cc6508cd80c1 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:50.086551 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-ba561b3d-ad49-406a-98e7-b8c49721145d req-d9075590-ac7f-445f-909c-cc6508cd80c1 service nova] Creating event network-vif-deleted:020ec9b3-10b6-48ee-9f35-59587ddb3bf5 for instance a016ddd5-58a8-4b20-b190-93d35048debc on hv-cinder-82611 Jan 24 17:00:50.091678 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-ba561b3d-ad49-406a-98e7-b8c49721145d req-d9075590-ac7f-445f-909c-cc6508cd80c1 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036239 Jan 24 17:00:50.092293 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 612/1241] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:00:50.425241 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:50.425902 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:00:50.435217 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:50.435671 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:50.436533 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:50.437161 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:50.472028 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:50.472485 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:50.472946 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.objects.instance [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lazy-loading 'fault' on Instance uuid a016ddd5-58a8-4b20-b190-93d35048debc {{(pid=127827) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 17:00:50.519573 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef20979970584d92b04462166e7059b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511e72017a4b4da7a0748dae5a59e0ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:00:50.528078 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-16e525e6-4f6f-43cf-b21e-3721559f32b0 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 200 len: 1226 microversion: 2.1 time: 0.106692 Jan 24 17:00:50.528434 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 630/1242] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:00:50 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 1226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:00:51.545669 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:51.546372 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] [instance: a016ddd5-58a8-4b20-b190-93d35048debc] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:00:51.553408 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:51.553856 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:51.554636 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:00:51.555110 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:00:51.570066 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] HTTP exception thrown: Instance a016ddd5-58a8-4b20-b190-93d35048debc could not be found. Jan 24 17:00:51.570643 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Returning 404 to user: Instance a016ddd5-58a8-4b20-b190-93d35048debc could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 17:00:51.571480 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-08ece7d1-6cd1-462e-9aa0-9a6c7e8c8fe5 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jan 24 17:00:51.572016 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 613/1243] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:00:51 2022] GET /compute/v2.1/servers/a016ddd5-58a8-4b20-b190-93d35048debc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 24 17:00:51.731895 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-b9a28d93-5703-40f2-923b-e8b3fe0d2d28 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] Calling method '.version_select at 0x7fba14e79f70>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:00:51.754223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-b9a28d93-5703-40f2-923b-e8b3fe0d2d28 tempest-TestShelveInstance-1633139369 tempest-TestShelveInstance-1633139369-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665389750" status: 202 len: 0 microversion: 2.1 time: 0.025966 Jan 24 17:00:51.758285 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 631/1244] 10.222.0.117 () {58 vars in 1255 bytes} [Mon Jan 24 17:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-665389750 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 24 17:01:13.220650 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-539062503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1092702864", "security_groups": [{"name": "tempest-secgroup-smoke-245594148"}], "block_device_mapping_v2": [{"uuid": "25e1d01c-546b-4836-94a7-79628a5e20c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65b89cb5-235f-4d33-82a0-9e74a9bccb1e"}]}} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:01:13.347486 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.network.neutron [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] validate_networks() for [('65b89cb5-235f-4d33-82a0-9e74a9bccb1e', None, None, None, None, None)] {{(pid=127826) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 24 17:01:13.860690 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 24 17:01:13.861119 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image limits 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 24 17:01:13.861864 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Flavor pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 24 17:01:13.862278 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Image pref 0:0:0 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 24 17:01:13.863149 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.virt.hardware [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 24 17:01:13.875898 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:13.876271 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:13.877092 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:13.877559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:13.894520 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 24 17:01:13.898855 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.quota [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Getting quotas for user 40a416737b484014bb7cf011bab63b63 and project 7a337369b3dc467394f2629fb2f8487c. Resources: {'cores', 'instances', 'ram'} {{(pid=127826) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 24 17:01:13.953115 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Going to run 1 instances... {{(pid=127826) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 24 17:01:13.955266 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25e1d01c-546b-4836-94a7-79628a5e20c7',volume_size=None,volume_type=None)] {{(pid=127826) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 24 17:01:14.084150 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-7d41e3cb-529b-43ee-b1dd-a569dcb4868d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.867229 Jan 24 17:01:14.084778 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 614/1245] 10.222.0.117 () {60 vars in 1151 bytes} [Mon Jan 24 17:01:13 2022] POST /compute/v2.1/servers => generated 407 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jan 24 17:01:14.094776 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-c29bb0f6-77a0-4ec3-8fee-54f2ce23bcb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:14.095383 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-c29bb0f6-77a0-4ec3-8fee-54f2ce23bcb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:14.157823 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-c29bb0f6-77a0-4ec3-8fee-54f2ce23bcb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:14.166711 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-c29bb0f6-77a0-4ec3-8fee-54f2ce23bcb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1097 microversion: 2.1 time: 0.076034 Jan 24 17:01:14.167322 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 632/1246] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:14 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1097 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:15.184756 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:15.185481 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:15.192847 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:15.193303 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:15.194098 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:15.194542 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:15.262209 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:15.271890 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-f38faa73-3187-46f2-b331-7261f0d276ba tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1195 microversion: 2.1 time: 0.091321 Jan 24 17:01:15.272479 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 615/1247] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:15 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1195 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 24 17:01:16.291101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:16.292177 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:16.299400 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:16.300163 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:16.301876 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:16.302857 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:16.734101 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:16.742530 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-6cb21505-7313-4d8f-a904-829341a89efa tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.455963 Jan 24 17:01:16.743154 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 633/1248] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:16 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:17.140004 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [req-0a0b4009-bde6-42f4-a56f-2b3f3e9ef561 req-99d85f55-e3a3-48f8-aa18-6fcd007b6071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75d929-c5ec-4846-9944-5be031c66ccb", "tag": "2b22c683-df00-408c-8bd2-3daea4e20a20"}]} {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:01:17.141807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:01:17.141807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: warnings.warn(msg) Jan 24 17:01:17.162375 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0a0b4009-bde6-42f4-a56f-2b3f3e9ef561 req-99d85f55-e3a3-48f8-aa18-6fcd007b6071 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:17.162996 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [req-0a0b4009-bde6-42f4-a56f-2b3f3e9ef561 req-99d85f55-e3a3-48f8-aa18-6fcd007b6071 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:17.175537 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.compute.server_external_events [req-0a0b4009-bde6-42f4-a56f-2b3f3e9ef561 req-99d85f55-e3a3-48f8-aa18-6fcd007b6071 service nova] Creating event network-changed:2b22c683-df00-408c-8bd2-3daea4e20a20 for instance 3d75d929-c5ec-4846-9944-5be031c66ccb on hv-cinder-82611 Jan 24 17:01:17.181925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [req-0a0b4009-bde6-42f4-a56f-2b3f3e9ef561 req-99d85f55-e3a3-48f8-aa18-6fcd007b6071 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051646 Jan 24 17:01:17.183183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 616/1249] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:01:17.759969 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:17.760572 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:17.767041 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:17.767523 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:17.768311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:17.768748 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:17.957613 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:17.964930 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-1e1369c5-c5e9-4506-8363-3c2dcf459504 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.208704 Jan 24 17:01:17.965508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 634/1250] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:17 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:18.981742 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:18.982441 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:18.988906 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:18.989357 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:18.990161 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:18.990701 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:19.124038 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:19.131760 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-2b9d24e5-c495-4e5b-9548-8f9122c3b1e6 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.153997 Jan 24 17:01:19.132331 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 617/1251] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:18 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:20.148519 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:20.149051 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:20.155165 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:20.155615 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:20.156465 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:20.156810 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:20.289459 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:20.296620 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-32bf54a6-fd63-4b0d-baa9-bbb67ef74de2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.152690 Jan 24 17:01:20.297180 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 635/1252] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:20 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:21.313573 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:21.314223 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:21.320685 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:21.321137 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:21.321922 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:21.322355 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:21.455910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:21.463706 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-deb839e7-e237-465d-82eb-31ae9999cd0c tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.153840 Jan 24 17:01:21.464276 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 618/1253] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:21 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:22.480284 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:22.480825 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:22.487148 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:22.487663 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:22.488447 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:22.488933 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:22.623208 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:22.630440 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-cef55173-907b-47c4-b087-b655bf483bb2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.154005 Jan 24 17:01:22.631031 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 636/1254] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:22 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:23.647874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:23.648474 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:23.655505 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:23.655955 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:23.656726 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:23.657157 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:23.787552 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:23.795586 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0f9cde35-5377-4e9d-9cde-42b45ec52bc9 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.151498 Jan 24 17:01:23.796171 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 619/1255] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:23 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:24.813757 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:24.814380 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:24.822837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:24.823384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:24.824192 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:24.824639 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:24.978246 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:24.994770 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-eea59fe5-9d0b-46d8-a6a3-30ff9a6bcf39 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.184535 Jan 24 17:01:24.995376 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 637/1256] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:24 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:26.011495 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:26.012107 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:26.018345 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:26.018813 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:26.019587 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:26.020020 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:26.157522 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:26.166286 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c0208921-6fba-40fb-9e88-7cd1764f1dd2 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.158622 Jan 24 17:01:26.166869 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 620/1257] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:26 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:26.810067 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-9c9aa9c1-a5ab-43cc-9fef-35d413b75800 req-4ba764c1-c1e2-4cfc-85c8-52ac4bfe969b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d75d929-c5ec-4846-9944-5be031c66ccb", "name": "network-vif-plugged", "status": "completed", "tag": "2b22c683-df00-408c-8bd2-3daea4e20a20"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:01:26.811808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:01:26.811808 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:01:26.818744 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-9c9aa9c1-a5ab-43cc-9fef-35d413b75800 req-4ba764c1-c1e2-4cfc-85c8-52ac4bfe969b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:26.819212 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-9c9aa9c1-a5ab-43cc-9fef-35d413b75800 req-4ba764c1-c1e2-4cfc-85c8-52ac4bfe969b service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:26.830553 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-9c9aa9c1-a5ab-43cc-9fef-35d413b75800 req-4ba764c1-c1e2-4cfc-85c8-52ac4bfe969b service nova] Creating event network-vif-plugged:2b22c683-df00-408c-8bd2-3daea4e20a20 for instance 3d75d929-c5ec-4846-9944-5be031c66ccb on hv-cinder-82611 Jan 24 17:01:26.836216 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-9c9aa9c1-a5ab-43cc-9fef-35d413b75800 req-4ba764c1-c1e2-4cfc-85c8-52ac4bfe969b service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146384 Jan 24 17:01:26.836806 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 638/1258] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:01:27.183350 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:27.183960 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:27.190159 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:27.190637 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:27.191450 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:27.191910 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:27.325263 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:27.332596 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-cc8767de-8330-4df4-b2a9-b6687269bcdd tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1268 microversion: 2.1 time: 0.153491 Jan 24 17:01:27.333154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 621/1259] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:27 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:28.350467 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:28.351197 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:28.357950 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:28.358401 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:28.359210 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:28.359650 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:28.498281 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:28.505648 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-049dfe63-9f79-49ab-a3fe-3b6eb6213e02 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1454 microversion: 2.1 time: 0.159921 Jan 24 17:01:28.506219 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 639/1260] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:28 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:28.522904 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:01:28.523559 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:01:28.529876 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:28.530333 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:28.531154 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:28.531597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:28.661992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:01:28.669611 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-02bc97b7-b93c-44a6-80ec-921700c14ee0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1454 microversion: 2.1 time: 0.150325 Jan 24 17:01:28.670183 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 622/1261] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:01:28 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:01:30.653395 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-4c67cf2a-44b6-49b4-8333-03e66c48dd0d req-6f7b900f-7e6f-40c8-a525-19fcba0bbfea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75d929-c5ec-4846-9944-5be031c66ccb", "tag": "2b22c683-df00-408c-8bd2-3daea4e20a20"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:01:30.655062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:01:30.655062 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:01:30.662589 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-4c67cf2a-44b6-49b4-8333-03e66c48dd0d req-6f7b900f-7e6f-40c8-a525-19fcba0bbfea service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:01:30.663129 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-4c67cf2a-44b6-49b4-8333-03e66c48dd0d req-6f7b900f-7e6f-40c8-a525-19fcba0bbfea service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:01:30.675140 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-4c67cf2a-44b6-49b4-8333-03e66c48dd0d req-6f7b900f-7e6f-40c8-a525-19fcba0bbfea service nova] Creating event network-changed:2b22c683-df00-408c-8bd2-3daea4e20a20 for instance 3d75d929-c5ec-4846-9944-5be031c66ccb on hv-cinder-82611 Jan 24 17:01:30.680709 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-4c67cf2a-44b6-49b4-8333-03e66c48dd0d req-6f7b900f-7e6f-40c8-a525-19fcba0bbfea service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085567 Jan 24 17:01:30.681761 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 640/1262] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:02:07.371661 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:02:07.372223 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:03:10.422379 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1a36492a-cd47-4280-8170-149f74036b0a] AMQP server on 10.222.0.117:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jan 24 17:03:10.425632 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02ac539d-26d3-4db4-aa87-fefad79e5190] AMQP server on 10.222.0.117:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 24 17:03:10.426871 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:10.427449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:10.429636 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-63331fbc-e80f-4726-b81f-e62f9de7e901 req-2a5547c9-d332-4b71-866b-6f32123a6c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d75d929-c5ec-4846-9944-5be031c66ccb", "tag": "2b22c683-df00-408c-8bd2-3daea4e20a20"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:03:10.431175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:03:10.431175 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:03:10.433715 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:10.434234 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:10.435440 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:10.435953 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:10.438809 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-63331fbc-e80f-4726-b81f-e62f9de7e901 req-2a5547c9-d332-4b71-866b-6f32123a6c70 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:10.439259 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-63331fbc-e80f-4726-b81f-e62f9de7e901 req-2a5547c9-d332-4b71-866b-6f32123a6c70 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:10.451058 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-63331fbc-e80f-4726-b81f-e62f9de7e901 req-2a5547c9-d332-4b71-866b-6f32123a6c70 service nova] Creating event network-changed:2b22c683-df00-408c-8bd2-3daea4e20a20 for instance 3d75d929-c5ec-4846-9944-5be031c66ccb on hv-cinder-82611 Jan 24 17:03:10.456518 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-63331fbc-e80f-4726-b81f-e62f9de7e901 req-2a5547c9-d332-4b71-866b-6f32123a6c70 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Jan 24 17:03:10.457279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 641/1263] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:03:10.462963 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 17:03:10.554981 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-4093b9dc-f048-4295-aca8-fa5e8c2adb79 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "DELETE /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 204 len: 0 microversion: 2.1 time: 0.134166 Jan 24 17:03:10.555874 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 623/1264] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 17:03:10 2022] DELETE /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 17:03:10.566328 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:10.567273 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:10.574029 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:10.574788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:10.575779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:10.576428 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:10.824311 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:10.832921 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-e8b3298b-eb00-4cac-80f7-e4d11a9638c4 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1579 microversion: 2.1 time: 0.271575 Jan 24 17:03:10.833603 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 642/1265] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:10 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1579 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:11.851814 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:11.852510 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:11.859592 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:11.860039 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:11.860811 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:11.861243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:11.879688 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [-] [1a36492a-cd47-4280-8170-149f74036b0a] Reconnected to AMQP server on 10.222.0.117:5672 via [amqp] client with port 47786. Jan 24 17:03:11.999181 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:12.006649 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d695327e-d0d2-4106-895e-e33c6aa0295d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1460 microversion: 2.1 time: 0.158847 Jan 24 17:03:12.007243 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 624/1266] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:11 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:12.623327 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-0c658881-af16-4aae-ab43-1efc9378adc8 req-9d3506ee-a7c2-431c-887f-f9be2469c7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d75d929-c5ec-4846-9944-5be031c66ccb", "name": "network-vif-deleted", "tag": "2b22c683-df00-408c-8bd2-3daea4e20a20"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:03:12.625402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:03:12.625402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:03:12.642181 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] [02ac539d-26d3-4db4-aa87-fefad79e5190] Reconnected to AMQP server on 10.222.0.117:5672 via [amqp] client with port 47790. Jan 24 17:03:12.645390 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-0c658881-af16-4aae-ab43-1efc9378adc8 req-9d3506ee-a7c2-431c-887f-f9be2469c7d1 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:12.645846 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-0c658881-af16-4aae-ab43-1efc9378adc8 req-9d3506ee-a7c2-431c-887f-f9be2469c7d1 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:12.659651 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-0c658881-af16-4aae-ab43-1efc9378adc8 req-9d3506ee-a7c2-431c-887f-f9be2469c7d1 service nova] Creating event network-vif-deleted:2b22c683-df00-408c-8bd2-3daea4e20a20 for instance 3d75d929-c5ec-4846-9944-5be031c66ccb on hv-cinder-82611 Jan 24 17:03:12.665010 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-0c658881-af16-4aae-ab43-1efc9378adc8 req-9d3506ee-a7c2-431c-887f-f9be2469c7d1 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045320 Jan 24 17:03:12.665834 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 643/1267] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 24 17:03:13.024863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:13.025597 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:13.032410 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:13.032958 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:13.033846 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:13.034298 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:13.069992 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:13.070449 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:13.070940 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lazy-loading 'fault' on Instance uuid 3d75d929-c5ec-4846-9944-5be031c66ccb {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 17:03:13.109431 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:13.116863 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-d3eeee1a-5ff3-48b0-bae4-8138671f079f tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 200 len: 1233 microversion: 2.1 time: 0.095703 Jan 24 17:03:13.117438 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 625/1268] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:13 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:14.134798 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:14.135507 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 3d75d929-c5ec-4846-9944-5be031c66ccb] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:14.142095 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:14.142574 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:14.143637 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:14.144082 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:14.158837 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] HTTP exception thrown: Instance 3d75d929-c5ec-4846-9944-5be031c66ccb could not be found. Jan 24 17:03:14.159446 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Returning 404 to user: Instance 3d75d929-c5ec-4846-9944-5be031c66ccb could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 17:03:14.160288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-7b5eca1b-16c6-418a-83eb-1db6e0998f5a tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb" status: 404 len: 111 microversion: 2.1 time: 0.029634 Jan 24 17:03:14.160870 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 644/1269] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:14 2022] GET /compute/v2.1/servers/3d75d929-c5ec-4846-9944-5be031c66ccb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 17:03:17.197488 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:17.198001 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:17.199990 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-95923660-3f67-4d3c-b8fb-21cfec13e072 req-cd63ee0e-d3b3-4470-afd8-a317029374da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77a62339-b2a1-409a-9c18-64ec7f8263f7", "tag": "e43a4ce0-246d-42b6-873c-91ce5321e7de"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:03:17.202026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:03:17.202026 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:03:17.204305 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:17.204747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:17.205707 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:17.206590 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:17.211032 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-95923660-3f67-4d3c-b8fb-21cfec13e072 req-cd63ee0e-d3b3-4470-afd8-a317029374da service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:17.211488 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-95923660-3f67-4d3c-b8fb-21cfec13e072 req-cd63ee0e-d3b3-4470-afd8-a317029374da service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:17.231454 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Going to try to terminate instance {{(pid=127826) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 24 17:03:17.234168 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-95923660-3f67-4d3c-b8fb-21cfec13e072 req-cd63ee0e-d3b3-4470-afd8-a317029374da service nova] Creating event network-changed:e43a4ce0-246d-42b6-873c-91ce5321e7de for instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 on hv-cinder-82611 Jan 24 17:03:17.240288 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-95923660-3f67-4d3c-b8fb-21cfec13e072 req-cd63ee0e-d3b3-4470-afd8-a317029374da service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043934 Jan 24 17:03:17.241102 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 645/1270] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 17:03:17.311769 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-0653b743-ae60-4fc4-89b4-69508c0c4439 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "DELETE /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 204 len: 0 microversion: 2.1 time: 0.117896 Jan 24 17:03:17.313460 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 626/1271] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 17:03:17 2022] DELETE /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 24 17:03:17.325402 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:17.326106 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:17.332967 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:17.333788 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:17.334730 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:17.335362 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:17.576045 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.policy [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127827) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:17.584688 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-ab9c4e13-0092-46c8-87ea-db83eabe56ef tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1581 microversion: 2.1 time: 0.264137 Jan 24 17:03:17.585303 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 646/1272] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:17 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1581 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:18.602924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:18.603627 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:18.610176 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:18.610651 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:18.611621 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:18.612105 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:18.745529 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:18.753082 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-b1d28c88-288a-47ba-9120-927f53525b65 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1462 microversion: 2.1 time: 0.154316 Jan 24 17:03:18.754302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 627/1273] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:18 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1462 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:19.285522 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [req-c631c22a-8b8c-4145-ba3e-ae7c71f60a7b req-a0404b60-2f4c-45c6-8930-fe43cde89114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77a62339-b2a1-409a-9c18-64ec7f8263f7", "name": "network-vif-deleted", "tag": "e43a4ce0-246d-42b6-873c-91ce5321e7de"}]} {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 24 17:03:19.287718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 24 17:03:19.287718 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: warnings.warn(msg) Jan 24 17:03:19.297155 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-c631c22a-8b8c-4145-ba3e-ae7c71f60a7b req-a0404b60-2f4c-45c6-8930-fe43cde89114 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:19.297778 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [req-c631c22a-8b8c-4145-ba3e-ae7c71f60a7b req-a0404b60-2f4c-45c6-8930-fe43cde89114 service nova] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:19.311508 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.compute.server_external_events [req-c631c22a-8b8c-4145-ba3e-ae7c71f60a7b req-a0404b60-2f4c-45c6-8930-fe43cde89114 service nova] Creating event network-vif-deleted:e43a4ce0-246d-42b6-873c-91ce5321e7de for instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 on hv-cinder-82611 Jan 24 17:03:19.317498 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [req-c631c22a-8b8c-4145-ba3e-ae7c71f60a7b req-a0404b60-2f4c-45c6-8930-fe43cde89114 service nova] 10.222.0.117 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Jan 24 17:03:19.318384 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 647/1274] 10.222.0.117 () {64 vars in 1322 bytes} [Mon Jan 24 17:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 24 17:03:19.770924 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:19.771464 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:19.777747 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:19.778194 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:19.779007 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:19.779443 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:19.811186 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:19.811834 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:19.812002 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.objects.instance [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lazy-loading 'fault' on Instance uuid 77a62339-b2a1-409a-9c18-64ec7f8263f7 {{(pid=127826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 24 17:03:19.852302 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.policy [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40a416737b484014bb7cf011bab63b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a337369b3dc467394f2629fb2f8487c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127826) authorize /opt/stack/nova/nova/policy.py:199}} Jan 24 17:03:19.859941 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-c18c82e5-d370-4799-8280-369722e4ab29 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 200 len: 1234 microversion: 2.1 time: 0.093237 Jan 24 17:03:19.860518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 628/1275] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:19 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 1234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 24 17:03:20.877737 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:20.879113 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 77a62339-b2a1-409a-9c18-64ec7f8263f7] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:20.885746 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:20.886201 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:20.887022 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:20.887466 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:20.900110 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] HTTP exception thrown: Instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 could not be found. Jan 24 17:03:20.900728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Returning 404 to user: Instance 77a62339-b2a1-409a-9c18-64ec7f8263f7 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 17:03:20.901549 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-69f77826-7db4-4aaa-b4e9-ca03951563ec tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7" status: 404 len: 111 microversion: 2.1 time: 0.027891 Jan 24 17:03:20.902073 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 648/1276] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:20 2022] GET /compute/v2.1/servers/77a62339-b2a1-409a-9c18-64ec7f8263f7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 17:03:21.618698 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:21.619269 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.compute.api [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127826) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:21.625591 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:21.626050 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:21.626880 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:21.627322 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG oslo_concurrency.lockutils [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127826) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:21.641477 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.wsgi [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] HTTP exception thrown: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. Jan 24 17:03:21.642069 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Returning 404 to user: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. {{(pid=127826) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 17:03:21.642925 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-fc9010c6-321d-437b-af62-b8230218b11d tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "DELETE /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 404 len: 111 microversion: 2.1 time: 0.027975 Jan 24 17:03:21.643462 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 629/1277] 10.222.0.117 () {58 vars in 1243 bytes} [Mon Jan 24 17:03:21 2022] DELETE /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 17:03:21.651387 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '>' {{(pid=127827) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:21.651997 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.compute.api [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [instance: 921adf61-2d82-49af-8dd2-dd2fbbd585b4] Fetching instance by UUID {{(pid=127827) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 24 17:03:21.658038 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:21.658493 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:21.659321 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 24 17:03:21.659779 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG oslo_concurrency.lockutils [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Lock "3bdf354a-4c6c-4cd0-9468-d050de816b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127827) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 24 17:03:21.672854 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.wsgi [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] HTTP exception thrown: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. Jan 24 17:03:21.673460 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: DEBUG nova.api.openstack.wsgi [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Returning 404 to user: Instance 921adf61-2d82-49af-8dd2-dd2fbbd585b4 could not be found. {{(pid=127827) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 24 17:03:21.674257 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO nova.api.openstack.requestlog [None req-a05189e8-7406-4661-95e2-d3199247d0a0 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4" status: 404 len: 111 microversion: 2.1 time: 0.026546 Jan 24 17:03:21.674801 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: [pid: 127827|app: 0|req: 649/1278] 10.222.0.117 () {58 vars in 1240 bytes} [Mon Jan 24 17:03:21 2022] GET /compute/v2.1/servers/921adf61-2d82-49af-8dd2-dd2fbbd585b4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 24 17:03:22.951807 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: DEBUG nova.api.openstack.wsgi [None req-19d76171-8cf6-43c2-92f0-9a2edef72fc8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] Calling method '.version_select at 0x7fba14f62dc0>' {{(pid=127826) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 24 17:03:22.955283 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19d76171-8cf6-43c2-92f0-9a2edef72fc8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [dba689b1-ad46-4b83-9e50-938db30bf8e9] AMQP server on 10.222.0.117:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 24 17:03:23.964116 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [None req-19d76171-8cf6-43c2-92f0-9a2edef72fc8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] [dba689b1-ad46-4b83-9e50-938db30bf8e9] Reconnected to AMQP server on 10.222.0.117:5672 via [amqp] client with port 47846. Jan 24 17:03:23.983048 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO nova.api.openstack.requestlog [None req-19d76171-8cf6-43c2-92f0-9a2edef72fc8 tempest-TestVolumeBootPattern-1435515500 tempest-TestVolumeBootPattern-1435515500-project] 10.222.0.117 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1092702864" status: 202 len: 0 microversion: 2.1 time: 1.034831 Jan 24 17:03:23.983741 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: [pid: 127826|app: 0|req: 630/1279] 10.222.0.117 () {58 vars in 1267 bytes} [Mon Jan 24 17:03:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1092702864 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 24 17:03:48.800518 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:03:48.801207 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: Mon Jan 24 17:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:03:59.543521 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:03:59.544164 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:03:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:05:27.379813 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:05:27.380474 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:05:45.954437 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:05:45.955073 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: Mon Jan 24 17:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:05:57.390568 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:05:57.391176 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:05:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:07:08.810728 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:07:08.811394 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: Mon Jan 24 17:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:07:19.551963 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:07:19.552721 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:07:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:08:46.114275 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:08:46.114918 dv-cinder-826116-1-iscsi devstack@n-api.service[127826]: Mon Jan 24 17:08:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 24 17:08:47.387728 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 24 17:08:47.388279 dv-cinder-826116-1-iscsi devstack@n-api.service[127827]: Mon Jan 24 17:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!